May 25 00:59:43.995068 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 00:59:43.995081 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 00:59:43.995090 ip-10-0-142-62 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 00:59:43.995411 ip-10-0-142-62 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 00:59:54.234578 ip-10-0-142-62 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 00:59:54.234599 ip-10-0-142-62 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d37009939a4b480c96722fe22dce6bac --
May 25 01:02:14.086051 ip-10-0-142-62 systemd[1]: Starting Kubernetes Kubelet...
May 25 01:02:14.556567 ip-10-0-142-62 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:14.556567 ip-10-0-142-62 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 01:02:14.556567 ip-10-0-142-62 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:14.556567 ip-10-0-142-62 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 01:02:14.556567 ip-10-0-142-62 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:14.558323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.558234    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 01:02:14.562637 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562621    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562639    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562644    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562648    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562652    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562655    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562658    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562662    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562665    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562669    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562673    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562677    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:14.562675 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562680    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562683    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562686    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562688    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562691    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562694    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562696    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562699    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562701    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562704    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562706    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562709    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562712    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562715    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562717    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562720    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562724    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562727    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562729    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562732    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:14.562974 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562735    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562737    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562740    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562742    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562745    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562747    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562750    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562752    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562755    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562757    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562760    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562762    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562765    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562767    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562784    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562787    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562789    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562792    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562794    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562797    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:14.563432 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562799    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562802    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562804    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562807    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562809    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562812    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562814    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562817    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562820    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562822    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562825    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562827    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562830    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562832    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562835    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562837    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562840    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562843    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562845    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562848    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:14.563944 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562852    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562855    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562857    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562860    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562863    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562865    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562869    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562872    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562875    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562877    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562880    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562883    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562885    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.562888    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563286    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563291    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563294    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563298    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563301    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563303    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:14.564420 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563306    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563309    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563311    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563314    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563317    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563319    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563322    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563324    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563328    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563331    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563334    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563337    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563339    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563342    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563344    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563347    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563350    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563353    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563357    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:14.564909 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563359    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563362    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563365    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563367    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563369    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563372    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563374    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563377    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563379    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563381    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563384    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563386    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563389    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563392    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563394    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563396    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563399    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563401    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563404    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563406    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:14.565362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563408    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563411    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563414    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563417    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563419    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563422    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563424    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563428    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563433    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563437    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563440    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563444    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563447    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563450    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563453    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563456    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563459    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563461    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563464    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563467    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:14.565869 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563469    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563472    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563475    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563478    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563480    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563483    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563485    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563488    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563490    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563493    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563495    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563498    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563500    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563502    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563506    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563508    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563511    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563513    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563516    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563518    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:14.566378 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.563521    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564945    2575 flags.go:64] FLAG: --address="0.0.0.0"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564955    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564962    2575 flags.go:64] FLAG: --anonymous-auth="true"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564967    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564972    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564975    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564980    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564984    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564987    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564991    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564994    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.564998    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565001    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565004    2575 flags.go:64] FLAG: --cgroup-root=""
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565007    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565010    2575 flags.go:64] FLAG: --client-ca-file=""
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565012    2575 flags.go:64] FLAG: --cloud-config=""
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565015    2575 flags.go:64] FLAG: --cloud-provider="external"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565019    2575 flags.go:64] FLAG: --cluster-dns="[]"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565023    2575 flags.go:64] FLAG: --cluster-domain=""
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565026    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565029    2575 flags.go:64] FLAG: --config-dir=""
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565032    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565035    2575 flags.go:64] FLAG: --container-log-max-files="5"
May 25 01:02:14.566876 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565039    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565042    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565045    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565048    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565051    2575 flags.go:64] FLAG: --contention-profiling="false"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565054    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565057    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565060    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565064    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565068    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565071    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565075    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565078    2575 flags.go:64] FLAG: --enable-load-reader="false"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565081    2575 flags.go:64] FLAG: --enable-server="true"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565084    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565089    2575 flags.go:64] FLAG: --event-burst="100"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565093    2575 flags.go:64] FLAG: --event-qps="50"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565096    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565099    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565102    2575 flags.go:64] FLAG: --eviction-hard=""
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565106    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565109    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565112    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565115    2575 flags.go:64] FLAG: --eviction-soft=""
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565118    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 01:02:14.567497 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565121    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565124    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565127    2575 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565130    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565133    2575 flags.go:64] FLAG: --fail-swap-on="true"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565135    2575 flags.go:64] FLAG: --feature-gates=""
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565139    2575 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565142    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565146    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565149    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565152    2575 flags.go:64] FLAG: --healthz-port="10248"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565155    2575 flags.go:64] FLAG: --help="false"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565159    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-142-62.ec2.internal"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565162    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565165    2575 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565168    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565171    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565175    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565178    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565181    2575 flags.go:64] FLAG: --image-service-endpoint=""
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565184    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565187    2575 flags.go:64] FLAG: --kube-api-burst="100"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565190    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565193    2575 flags.go:64] FLAG: --kube-api-qps="50"
May 25 01:02:14.568107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565196    2575 flags.go:64] FLAG: --kube-reserved=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565198    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565201    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565204    2575 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565207    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565210    2575 flags.go:64] FLAG: --lock-file=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565213    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565215    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565219    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565224    2575 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565226    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565230    2575 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565232    2575 flags.go:64] FLAG: --logging-format="text"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565235    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565239    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565242    2575 flags.go:64] FLAG: --manifest-url=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565245    2575 flags.go:64] FLAG: --manifest-url-header=""
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565250    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565253    2575 flags.go:64] FLAG: --max-open-files="1000000"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565257    2575 flags.go:64] FLAG: --max-pods="110"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565260    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565263    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565265    2575 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565268    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565271    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 01:02:14.568682 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565274    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565277    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565285    2575 flags.go:64] FLAG: --node-status-max-images="50"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565288    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565291    2575 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565294    2575 flags.go:64] FLAG: --pod-cidr=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565297    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565302    2575 flags.go:64] FLAG: --pod-manifest-path=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565305    2575 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565308    2575 flags.go:64] FLAG: --pods-per-core="0"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565311    2575 flags.go:64] FLAG: --port="10250"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565314    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565317    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b523c86345eb3e5c"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565320    2575 flags.go:64] FLAG: --qos-reserved=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565323    2575 flags.go:64] FLAG: --read-only-port="10255"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565326    2575 flags.go:64] FLAG: --register-node="true"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565329    2575 flags.go:64] FLAG: --register-schedulable="true"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565332    2575 flags.go:64] FLAG: --register-with-taints=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565335    2575 flags.go:64] FLAG: --registry-burst="10"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565338    2575 flags.go:64] FLAG: --registry-qps="5"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565341    2575 flags.go:64] FLAG: --reserved-cpus=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565343    2575 flags.go:64] FLAG: --reserved-memory=""
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565347    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565350    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565353    2575 flags.go:64] FLAG: --rotate-certificates="false"
May 25 01:02:14.569319 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565356    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565359    2575 flags.go:64] FLAG: --runonce="false"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565362    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565366    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565369    2575 flags.go:64] FLAG: --seccomp-default="false"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565372    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565375    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565379    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565382    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565385    2575 flags.go:64] FLAG: --storage-driver-password="root"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565388    2575 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565391    2575 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565394    2575 flags.go:64] FLAG: --storage-driver-user="root"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565397    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565400    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565403    2575 flags.go:64] FLAG: --system-cgroups=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565406    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565411    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565414    2575 flags.go:64] FLAG: --tls-cert-file=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565417    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565421    2575 flags.go:64] FLAG: --tls-min-version=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565424    2575 flags.go:64] FLAG: --tls-private-key-file=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565426    2575 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565429    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565432    2575 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 01:02:14.569928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565435    2575 flags.go:64] FLAG: --v="2"
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565439    2575 flags.go:64] FLAG: --version="false"
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565443    2575 flags.go:64] FLAG: --vmodule=""
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565447    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.565450    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565545    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565549    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565552    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565555    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565558    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565561    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565564    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565568    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565571    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565573    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565576    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565579    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565582    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565585    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565588    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565591    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:14.570527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565593    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565596    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565599    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565601    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565604    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565606    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565609    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565612    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565615    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565617    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565619    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565622    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565624    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565627    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565629    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565632    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565635    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565637    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565640    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565643    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:14.571061 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565645    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565648    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565651    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565653    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565656    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565659    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565663    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565666    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565668    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565671    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565674    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565676    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565679    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565681    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565684    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565686    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565689    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565691    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565694    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565696    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:14.571569 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565698    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565701    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565704    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565706    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565709    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565711    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565714    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565716    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565721    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565724    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565730    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565732    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565735    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565738    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565740    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565743    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565745    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565748    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565750    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565753    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:14.572068 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565756    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565758    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565761    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565763    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565780    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565784    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565788    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565791    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565793    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.565796    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:14.572848 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.566407    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:14.575862 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.575821    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 01:02:14.575862 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.575840    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 01:02:14.575952 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575943    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:14.575952 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575952    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575957    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575960    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575963    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575966    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575969    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575972    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575975    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575978    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575983    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575986    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575990    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575994    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.575997    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576000    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576004    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576006    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576010    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576013    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576015    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:14.576010 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576018    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576024    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576027    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576030    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576033    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576036    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576040    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576044    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576048    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576051    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576054    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576057    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576060    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576066    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576069    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576072    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576075    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576078    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576081    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:14.576492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576084    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576086    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576089    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576092    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576095    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576098    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576101    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576106    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576110    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576113    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576117    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576119    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576122    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576124    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576127    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576131    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576134    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576137    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576140    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:14.577008 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576142    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576148    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576150    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576154    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576156    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576159    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576162    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576165    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576168    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576170    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576173    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576176    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576178    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576181    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576186    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576188    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576191    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576194    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576197    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576199    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:14.577476 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576202    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576205    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576208    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576211    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576214    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576217    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576223    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.576228    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576415    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576420    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576423    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576427    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576433    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576436    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576439    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576441    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:14.577984 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576444    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576447    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576449    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576452    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576455    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576457    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576460    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576463    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576465    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576470    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576473    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576476    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576479    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576482    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576484    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576487    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576490    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576492    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576495    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576498    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:14.578391 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576501    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576504    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576509    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576512    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576515    2575 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576518    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576520    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576524    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576526    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576529    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576532    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576536    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576539    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576542    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576547    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576550    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576552    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576555    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576558    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:14.578881 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576561    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576563    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576568    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576571    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576574    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576577    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576580    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576586    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576589    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576592    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576595    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576598    2575 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576601    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576604    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576607    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576610    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576612    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576615    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576618    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576621    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:14.579347 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576626    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576628    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576631    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576634    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576636    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576639    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576641    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576644    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576647    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576649    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576652    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576654    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576659    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576662    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576665    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576667    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576670    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576673    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:14.579924 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:14.576676    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:14.580348 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.576681    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:14.580348 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.577470    2575 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 01:02:14.581197 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.581183    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 01:02:14.582365 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.582343    2575 server.go:1019] "Starting client certificate rotation"
May 25 01:02:14.582481 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.582461    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:14.582541 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.582515    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:14.609736 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.609712    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:14.611617 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.611596    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:14.624871 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.624853    2575 log.go:25] "Validated CRI v1 runtime API"
May 25 01:02:14.630317 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.630302    2575 log.go:25] "Validated CRI v1 image API"
May 25 01:02:14.632127 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.632106    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 01:02:14.636106 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.636084    2575 fs.go:135] Filesystem UUIDs: map[167e99a2-f7b4-4556-8bcf-8a68c49f5eda:/dev/nvme0n1p4 4cb40625-dbba-4e92-bf92-8b9436ef5cd9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 25 01:02:14.636171 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.636105    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 01:02:14.640322 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.640217    2575 manager.go:217] Machine: {Timestamp:2026-05-25 01:02:14.639668139 +0000 UTC m=+0.429874737 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110391 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1cfb2e65a7eb2e3cf2cbe6f9df45 SystemUUID:ec2d1cfb-2e65-a7eb-2e3c-f2cbe6f9df45 BootID:d3700993-9a4b-480c-9672-2fe22dce6bac Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:90:28:e9:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:90:28:e9:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:87:d3:cd:4e:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 01:02:14.640322 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.640314    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 01:02:14.640471 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.640388    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 01:02:14.642524 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.642499    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 01:02:14.642697 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.642525    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-62.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 01:02:14.642838 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.642711    2575 topology_manager.go:138] "Creating topology manager with none policy"
May 25 01:02:14.642838 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.642729    2575 container_manager_linux.go:306] "Creating device plugin manager"
May 25 01:02:14.642838 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.642744    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:14.643673 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.643660    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:14.644940 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.644923    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:14.645829 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.645815    2575 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:14.646120 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.646107    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 01:02:14.648937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.648925    2575 kubelet.go:491] "Attempting to sync node with API server"
May 25 01:02:14.649025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.648944    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 01:02:14.649025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.648960    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 01:02:14.649025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.648972    2575 kubelet.go:397] "Adding apiserver pod source"
May 25 01:02:14.649025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.648985    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 01:02:14.652024 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.652004    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:14.652107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.652037    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:14.655880 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.655862    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 01:02:14.657915 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.657901    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 01:02:14.658885 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658872    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658890    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658896    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658901    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658909    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658915    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658920    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 01:02:14.658928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658926    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 01:02:14.659105 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658933    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 01:02:14.659105 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658939    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 01:02:14.659105 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.658947    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 01:02:14.659312 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.659303    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 01:02:14.660997 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.660985    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 01:02:14.660997 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.660996    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 01:02:14.663565 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.663539    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 01:02:14.663565 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.663541    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 01:02:14.663679 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.663626    2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-62.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 01:02:14.664148 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.664135    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 01:02:14.664195 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.664176    2575 server.go:1295] "Started kubelet"
May 25 01:02:14.664365 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.664298    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 01:02:14.664440 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.664383    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 01:02:14.664892 ip-10-0-142-62 systemd[1]: Started Kubernetes Kubelet.
May 25 01:02:14.665453 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.665396    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 01:02:14.665789 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.665706    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 01:02:14.668513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.668499    2575 server.go:317] "Adding debug handlers to kubelet server"
May 25 01:02:14.673874 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.673856    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 01:02:14.673874 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.673868    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 01:02:14.674026 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.673946    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 01:02:14.674026 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.673957    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 01:02:14.674813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.674316    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 01:02:14.674813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.674391    2575 reconstruct.go:97] "Volume reconstruction finished"
May 25 01:02:14.674813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.674399    2575 reconciler.go:26] "Reconciler: start to sync state"
May 25 01:02:14.675385 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.675365    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:14.675734 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.675719    2575 factory.go:55] Registering systemd factory
May 25 01:02:14.675837 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.675738    2575 factory.go:223] Registration of the systemd container factory successfully
May 25 01:02:14.675987 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.675971    2575 factory.go:153] Registering CRI-O factory
May 25 01:02:14.676059 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.675991    2575 factory.go:223] Registration of the crio container factory successfully
May 25 01:02:14.676059 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.676044    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 01:02:14.676165 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.676063    2575 factory.go:103] Registering Raw factory
May 25 01:02:14.676165 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.676078    2575 manager.go:1196] Started watching for new ooms in manager
May 25 01:02:14.676395 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.676381    2575 manager.go:319] Starting recovery of all containers
May 25 01:02:14.677956 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.677915    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 01:02:14.679281 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.679254    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-62.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 25 01:02:14.680366 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.679321    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-62.ec2.internal.18b2a94935be76ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-62.ec2.internal,UID:ip-10-0-142-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-62.ec2.internal,},FirstTimestamp:2026-05-25 01:02:14.664148653 +0000 UTC m=+0.454355252,LastTimestamp:2026-05-25 01:02:14.664148653 +0000 UTC m=+0.454355252,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-62.ec2.internal,}"
May 25 01:02:14.680701 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.680662    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 25 01:02:14.688845 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.688826    2575 manager.go:324] Recovery completed
May 25 01:02:14.689042 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.689018    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t6znv"
May 25 01:02:14.692965 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.692953    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.694689 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.694674    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.694755 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.694703    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.694755 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.694734    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.695123 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.695106    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t6znv"
May 25 01:02:14.695205 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.695192    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 01:02:14.695205 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.695204    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 01:02:14.695272 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.695221    2575 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:14.696579 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.696514    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-62.ec2.internal.18b2a94937907b73  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-62.ec2.internal,UID:ip-10-0-142-62.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-62.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-62.ec2.internal,},FirstTimestamp:2026-05-25 01:02:14.694689651 +0000 UTC m=+0.484896249,LastTimestamp:2026-05-25 01:02:14.694689651 +0000 UTC m=+0.484896249,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-62.ec2.internal,}"
May 25 01:02:14.698198 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.698185    2575 policy_none.go:49] "None policy: Start"
May 25 01:02:14.698260 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.698201    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 01:02:14.698260 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.698212    2575 state_mem.go:35] "Initializing new in-memory state store"
May 25 01:02:14.746435 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746363    2575 manager.go:341] "Starting Device Plugin manager"
May 25 01:02:14.746435 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.746396    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 01:02:14.746435 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746407    2575 server.go:85] "Starting device plugin registration server"
May 25 01:02:14.746636 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746624    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 01:02:14.746673 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746640    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 01:02:14.746745 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746728    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 01:02:14.746867 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746834    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 01:02:14.746867 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.746851    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 01:02:14.747475 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.747454    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 01:02:14.747542 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.747490    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:14.765928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.765903    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 01:02:14.767040 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.767021    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 01:02:14.767040 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.767039    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 01:02:14.767173 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.767071    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 01:02:14.767173 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.767088    2575 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 01:02:14.767173 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.767131    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 01:02:14.770702 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.770682    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:14.846850 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.846785    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.847869 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.847849    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.847947 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.847880    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.847947 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.847891    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.847947 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.847911    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-62.ec2.internal"
May 25 01:02:14.856908 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.856894    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-62.ec2.internal"
May 25 01:02:14.856951 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.856915    2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-62.ec2.internal\": node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:14.867224 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.867207    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"]
May 25 01:02:14.867278 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.867264    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.868556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.868543    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.868620 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.868569    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.868620 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.868583    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.868911 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.868896    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:14.870885 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.870874    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.871071 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871060    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:14.871104 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871087    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.871514 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871497    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.871577 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871540    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.871577 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871550    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.871637 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871502    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.871637 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871602    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.871637 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.871616    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.874007 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.873992    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:14.874063 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.874023    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:14.874680 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.874666    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:14.874743 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.874686    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:14.874743 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.874702    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:14.902336 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.902314    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-62.ec2.internal\" not found" node="ip-10-0-142-62.ec2.internal"
May 25 01:02:14.906664 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.906648    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-62.ec2.internal\" not found" node="ip-10-0-142-62.ec2.internal"
May 25 01:02:14.969464 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:14.969441    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:14.975754 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.975731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:14.975823 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.975757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:14.975823 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:14.975807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9967a8879fa48b19b7c0f1227c168553-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"9967a8879fa48b19b7c0f1227c168553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.069907 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.069870    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.076176 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076157    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.076230 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076184    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.076230 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076211    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9967a8879fa48b19b7c0f1227c168553-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"9967a8879fa48b19b7c0f1227c168553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.076291 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.076291 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076266    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9967a8879fa48b19b7c0f1227c168553-config\") pod \"kube-apiserver-proxy-ip-10-0-142-62.ec2.internal\" (UID: \"9967a8879fa48b19b7c0f1227c168553\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.076347 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.076308    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b7bd44152f743cc1e5b6a72329980bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal\" (UID: \"7b7bd44152f743cc1e5b6a72329980bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.170631 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.170545    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.205975 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.205951    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.209664 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.209646    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:15.271033 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.271004    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.371599 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.371563    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.472564 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.472492    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.477317 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.477299    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:15.572591 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.572556    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.582038 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.582014    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 01:02:15.582185 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.582165    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:15.582230 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.582200    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:15.672844 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.672813    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.674011 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.673990    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 01:02:15.683763 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.683738    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:15.697363 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.697332    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 00:57:14 +0000 UTC" deadline="2028-01-04 12:16:03.994671801 +0000 UTC"
May 25 01:02:15.697363 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.697357    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14147h13m48.297318162s"
May 25 01:02:15.707698 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.707677    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxqm9"
May 25 01:02:15.717441 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.717423    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxqm9"
May 25 01:02:15.757465 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:15.757425    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9967a8879fa48b19b7c0f1227c168553.slice/crio-edef454592854ac65a5d818f464303e9c12a21fcb2829b32a0cb6e40ba24ead3 WatchSource:0}: Error finding container edef454592854ac65a5d818f464303e9c12a21fcb2829b32a0cb6e40ba24ead3: Status 404 returned error can't find the container with id edef454592854ac65a5d818f464303e9c12a21fcb2829b32a0cb6e40ba24ead3
May 25 01:02:15.757650 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:15.757633    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7bd44152f743cc1e5b6a72329980bb.slice/crio-39d15a1b6a60f6a7de1b07825b9525263f20d1657dd80b313db58989729a3d44 WatchSource:0}: Error finding container 39d15a1b6a60f6a7de1b07825b9525263f20d1657dd80b313db58989729a3d44: Status 404 returned error can't find the container with id 39d15a1b6a60f6a7de1b07825b9525263f20d1657dd80b313db58989729a3d44
May 25 01:02:15.760339 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.760325    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:02:15.769466 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.769421    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"7b7bd44152f743cc1e5b6a72329980bb","Type":"ContainerStarted","Data":"39d15a1b6a60f6a7de1b07825b9525263f20d1657dd80b313db58989729a3d44"}
May 25 01:02:15.770239 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:15.770220    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" event={"ID":"9967a8879fa48b19b7c0f1227c168553","Type":"ContainerStarted","Data":"edef454592854ac65a5d818f464303e9c12a21fcb2829b32a0cb6e40ba24ead3"}
May 25 01:02:15.773736 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.773718    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.874206 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.874175    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:15.974638 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:15.974598    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-62.ec2.internal\" not found"
May 25 01:02:16.002564 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.002547    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:16.074757 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.074730    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal"
May 25 01:02:16.089917 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.089889    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:16.091143 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.091129    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal"
May 25 01:02:16.100588 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.100570    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:16.269055 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.268974    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:16.650416 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.650345    2575 apiserver.go:52] "Watching apiserver"
May 25 01:02:16.658365 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.658330    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 01:02:16.660398 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.660368    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-tn97q","openshift-image-registry/node-ca-hfwxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal","openshift-multus/multus-82jwn","openshift-network-diagnostics/network-check-target-lbzpv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x","openshift-multus/multus-additional-cni-plugins-wrq4z","openshift-multus/network-metrics-daemon-zghqp","openshift-network-operator/iptables-alerter-c8zkg","openshift-ovn-kubernetes/ovnkube-node-mmvhx","kube-system/konnectivity-agent-qtxsg","kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9lsxw"]
May 25 01:02:16.663048 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.663028    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:16.663217 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.663127    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:16.667434 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.667408    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.667537 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.667470    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.669645 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.669627    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.670343 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670322    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:16.670472 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670454    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 01:02:16.670564 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670532    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 01:02:16.670669 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670585    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 01:02:16.670669 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670461    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p9kr2\""
May 25 01:02:16.670811 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.670785    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hq8pn\""
May 25 01:02:16.672099 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.671999    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 01:02:16.675554 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.672984    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.675554 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.673030    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 01:02:16.675554 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.673598    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 01:02:16.675554 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.674431    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fq9zz\""
May 25 01:02:16.676521 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.676496    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 01:02:16.676783 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.676750    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wtc8\""
May 25 01:02:16.677210 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.677190    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 01:02:16.677295 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.677193    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 01:02:16.677295 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.677273    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 01:02:16.677654 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.677588    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 01:02:16.679359 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.679066    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82jwn"
May 25 01:02:16.681437 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.681416    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.681649 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.681630    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv4d5\""
May 25 01:02:16.681855 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.681840    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 01:02:16.683585 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.683569    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.683685 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.683630    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:16.683746 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.683726    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 01:02:16.683943 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.683928    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q58qf\""
May 25 01:02:16.684053 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.683998    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 01:02:16.686041 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686002    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-socket-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-sys-fs\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-kubelet\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686505    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-kubernetes\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-socket-dir-parent\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.686572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-hostroot\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-conf-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686640    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-system-cni-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686718    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-netns\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-bin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-daemon-config\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686810    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-systemd\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686833    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-device-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-k8s-cni-cncf-io\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686927    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-sys\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ea42f20-679e-47ed-934d-750480d95a60-agent-certs\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ea42f20-679e-47ed-934d-750480d95a60-konnectivity-ca\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.687191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686975    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-cnibin\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.686988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-os-release\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-os-release\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-cni-binary-copy\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-lib-modules\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687106    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-host\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-tuned\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687153    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-tmp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-cnibin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976l5\" (UniqueName: \"kubernetes.io/projected/0c5880d7-8d6f-4a98-869b-0363a11b2398-kube-api-access-976l5\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6x8t\" (UniqueName: \"kubernetes.io/projected/c9183920-32a1-4962-8487-5bc7818d4356-kube-api-access-v6x8t\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-system-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcljl\" (UniqueName: \"kubernetes.io/projected/4b44482d-18d6-448e-a580-da06c5e9e72a-kube-api-access-xcljl\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-multus\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.687952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-modprobe-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysconfig\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687511    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-conf\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-run\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-var-lib-kubelet\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-registration-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-multus-certs\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687634    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-etc-kubernetes\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.687658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8zp\" (UniqueName: \"kubernetes.io/projected/07506dc2-14a3-4361-b1a1-6f755828fd8b-kube-api-access-6p8zp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.688357    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.688654    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:16.688833 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.688751    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8xcl\""
May 25 01:02:16.689436 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.688852    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.689436 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.688997    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 01:02:16.690556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.690533    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 01:02:16.690826 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.690809    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g8bhk\""
May 25 01:02:16.691120 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.691102    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 01:02:16.691201 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.691108    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 01:02:16.691201 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.691108    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 01:02:16.691527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.691390    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 01:02:16.692179 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.692136    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 01:02:16.693372 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.692713    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 01:02:16.693372 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.692988    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 01:02:16.693372 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.693026    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rgczj\""
May 25 01:02:16.693372 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.693229    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 01:02:16.693372 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.693289    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 01:02:16.718146 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.718118    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:15 +0000 UTC" deadline="2027-11-23 13:15:26.226502043 +0000 UTC"
May 25 01:02:16.718238 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.718147    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13140h13m9.50835861s"
May 25 01:02:16.775150 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.775123    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 01:02:16.788456 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788434    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysconfig\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788461    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-var-lib-kubelet\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788491    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8zp\" (UniqueName: \"kubernetes.io/projected/07506dc2-14a3-4361-b1a1-6f755828fd8b-kube-api-access-6p8zp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788516    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-registration-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788540    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-multus-certs\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-etc-kubernetes\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788564    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysconfig\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788592 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788589    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788611    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-multus-certs\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44jv9\" (UniqueName: \"kubernetes.io/projected/6bce79ad-13fe-4feb-a06c-394b87713f64-kube-api-access-44jv9\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788633    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-etc-kubernetes\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788566    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-var-lib-kubelet\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-socket-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788673    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-sys-fs\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-registration-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788697    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788719    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-kubelet\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788736    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-kubernetes\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788739    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-sys-fs\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-systemd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788758    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-socket-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788784    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-etc-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788795    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-kubelet\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788815    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-kubernetes\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.788937 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788879    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-socket-dir-parent\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788915    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-hostroot\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788943    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788968    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-netns\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788980    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-socket-dir-parent\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.788992    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-bin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789017    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-daemon-config\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789041    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-systemd\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789064    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-sys\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789089    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ea42f20-679e-47ed-934d-750480d95a60-konnectivity-ca\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-node-log\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789144    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-device-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-slash\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-script-lib\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82c9n\" (UniqueName: \"kubernetes.io/projected/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-kube-api-access-82c9n\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789264    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.789513 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-iptables-alerter-script\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789291    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-binary-copy\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789315    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-os-release\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789355    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-os-release\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789374    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-hostroot\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789380    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-cni-binary-copy\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789412    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789421    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-lib-modules\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789434    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-device-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-kubelet\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789516    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-os-release\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789520    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-sys\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-host-slash\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-os-release\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789562    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-lib-modules\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhz9\" (UniqueName: \"kubernetes.io/projected/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-kube-api-access-9hhz9\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789608    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-bin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-systemd\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789638    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a32d2fe2-8269-4821-a1d1-8e5660df3c06-hosts-file\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789664    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-netns\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789668    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789729    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-976l5\" (UniqueName: \"kubernetes.io/projected/0c5880d7-8d6f-4a98-869b-0363a11b2398-kube-api-access-976l5\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789759    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789886    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xcljl\" (UniqueName: \"kubernetes.io/projected/4b44482d-18d6-448e-a580-da06c5e9e72a-kube-api-access-xcljl\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.789971    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-multus\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790048    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-cni-binary-copy\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790061    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790089    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-daemon-config\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-var-lib-cni-multus\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ea42f20-679e-47ed-934d-750480d95a60-konnectivity-ca\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790156    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-conf\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.790954 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790181    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-run\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-ovn\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790223    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790229    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bce79ad-13fe-4feb-a06c-394b87713f64-host\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bce79ad-13fe-4feb-a06c-394b87713f64-serviceca\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-run\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-bin\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790289    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-sysctl-conf\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-netd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-env-overrides\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790384    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-conf-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a32d2fe2-8269-4821-a1d1-8e5660df3c06-tmp-dir\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq7tg\" (UniqueName: \"kubernetes.io/projected/a32d2fe2-8269-4821-a1d1-8e5660df3c06-kube-api-access-qq7tg\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-log-socket\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790483    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-conf-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790499    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.791699 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790524    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-system-cni-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-var-lib-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovn-node-metrics-cert\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c5880d7-8d6f-4a98-869b-0363a11b2398-etc-selinux\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790646    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-system-cni-dir\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790687    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-k8s-cni-cncf-io\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790705    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-multus-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790715    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ea42f20-679e-47ed-934d-750480d95a60-agent-certs\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790737    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-host-run-k8s-cni-cncf-io\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790743    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-config\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790785    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-cnibin\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790813    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-host\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790821    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9183920-32a1-4962-8487-5bc7818d4356-cnibin\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790836    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-tuned\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790859    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-tmp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.792332 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790884    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-systemd-units\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-host\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.790993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-netns\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791046    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-cnibin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9183920-32a1-4962-8487-5bc7818d4356-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791053    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791078    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6x8t\" (UniqueName: \"kubernetes.io/projected/c9183920-32a1-4962-8487-5bc7818d4356-kube-api-access-v6x8t\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791114    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-cnibin\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791124    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-system-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqpt\" (UniqueName: \"kubernetes.io/projected/6b674d77-e2fe-4a63-a09a-29fa01243f3e-kube-api-access-llqpt\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b44482d-18d6-448e-a580-da06c5e9e72a-system-cni-dir\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791181    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-modprobe-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.792894 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.791308    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-modprobe-d\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.794205 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.794118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-tmp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.794205 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.794197    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/07506dc2-14a3-4361-b1a1-6f755828fd8b-etc-tuned\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.794353 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.794333    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ea42f20-679e-47ed-934d-750480d95a60-agent-certs\") pod \"konnectivity-agent-qtxsg\" (UID: \"8ea42f20-679e-47ed-934d-750480d95a60\") " pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:16.795750 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.795520    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:16.795750 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.795542    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:16.795750 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.795557    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:16.795750 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.795650    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:17.295606013 +0000 UTC m=+3.085812616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:16.797004 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.796973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8zp\" (UniqueName: \"kubernetes.io/projected/07506dc2-14a3-4361-b1a1-6f755828fd8b-kube-api-access-6p8zp\") pod \"tuned-9lsxw\" (UID: \"07506dc2-14a3-4361-b1a1-6f755828fd8b\") " pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.797886 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.797854    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcljl\" (UniqueName: \"kubernetes.io/projected/4b44482d-18d6-448e-a580-da06c5e9e72a-kube-api-access-xcljl\") pod \"multus-82jwn\" (UID: \"4b44482d-18d6-448e-a580-da06c5e9e72a\") " pod="openshift-multus/multus-82jwn"
May 25 01:02:16.798655 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.798632    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-976l5\" (UniqueName: \"kubernetes.io/projected/0c5880d7-8d6f-4a98-869b-0363a11b2398-kube-api-access-976l5\") pod \"aws-ebs-csi-driver-node-bxv6x\" (UID: \"0c5880d7-8d6f-4a98-869b-0363a11b2398\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:16.798950 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.798909    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6x8t\" (UniqueName: \"kubernetes.io/projected/c9183920-32a1-4962-8487-5bc7818d4356-kube-api-access-v6x8t\") pod \"multus-additional-cni-plugins-wrq4z\" (UID: \"c9183920-32a1-4962-8487-5bc7818d4356\") " pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:16.891831 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891796    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-node-log\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891848    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-slash\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891872    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891892    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-script-lib\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891908    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-node-log\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891912    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82c9n\" (UniqueName: \"kubernetes.io/projected/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-kube-api-access-82c9n\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.891993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891980    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-slash\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.891975    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892028    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-iptables-alerter-script\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892052    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-kubelet\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.892061    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892070    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-host-slash\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892096    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhz9\" (UniqueName: \"kubernetes.io/projected/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-kube-api-access-9hhz9\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:16.892126    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:17.392108691 +0000 UTC m=+3.182315299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892146    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a32d2fe2-8269-4821-a1d1-8e5660df3c06-hosts-file\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892197    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-ovn\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892221    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bce79ad-13fe-4feb-a06c-394b87713f64-host\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892245    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bce79ad-13fe-4feb-a06c-394b87713f64-serviceca\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892270    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-bin\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892313    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-netd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892334 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892338    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-env-overrides\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892363    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a32d2fe2-8269-4821-a1d1-8e5660df3c06-tmp-dir\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892407    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq7tg\" (UniqueName: \"kubernetes.io/projected/a32d2fe2-8269-4821-a1d1-8e5660df3c06-kube-api-access-qq7tg\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892446    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-log-socket\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892480    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892525    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-var-lib-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892548    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovn-node-metrics-cert\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892575    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-config\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892611    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-systemd-units\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-script-lib\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892637    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-netns\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892671    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-run-netns\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892686    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llqpt\" (UniqueName: \"kubernetes.io/projected/6b674d77-e2fe-4a63-a09a-29fa01243f3e-kube-api-access-llqpt\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892719    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-iptables-alerter-script\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892743    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44jv9\" (UniqueName: \"kubernetes.io/projected/6bce79ad-13fe-4feb-a06c-394b87713f64-kube-api-access-44jv9\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892803    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-systemd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.892981 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892831    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-etc-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892899    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-etc-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-kubelet\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a32d2fe2-8269-4821-a1d1-8e5660df3c06-hosts-file\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.892966    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-host-slash\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893021    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-ovn\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893254    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-bin\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893367    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-cni-netd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893448    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-run-systemd\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893918 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6bce79ad-13fe-4feb-a06c-394b87713f64-serviceca\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.893918 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-systemd-units\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.893980 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.893945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.894021 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-log-socket\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.894021 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894006    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovnkube-config\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.894096 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894010    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-var-lib-openvswitch\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.894096 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894059    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6bce79ad-13fe-4feb-a06c-394b87713f64-host\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.894325 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a32d2fe2-8269-4821-a1d1-8e5660df3c06-tmp-dir\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.896098 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.894494    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-env-overrides\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.897175 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.897154    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-ovn-node-metrics-cert\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.902595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.902518    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82c9n\" (UniqueName: \"kubernetes.io/projected/2140cd91-dd9d-49b9-b9fb-7ec7caa5656e-kube-api-access-82c9n\") pod \"ovnkube-node-mmvhx\" (UID: \"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:16.902703 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.902684    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhz9\" (UniqueName: \"kubernetes.io/projected/b0a7f20d-75f0-456d-a415-15cb8ca7adb3-kube-api-access-9hhz9\") pod \"iptables-alerter-c8zkg\" (UID: \"b0a7f20d-75f0-456d-a415-15cb8ca7adb3\") " pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:16.902791 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.902726    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq7tg\" (UniqueName: \"kubernetes.io/projected/a32d2fe2-8269-4821-a1d1-8e5660df3c06-kube-api-access-qq7tg\") pod \"node-resolver-tn97q\" (UID: \"a32d2fe2-8269-4821-a1d1-8e5660df3c06\") " pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:16.903451 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.903430    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqpt\" (UniqueName: \"kubernetes.io/projected/6b674d77-e2fe-4a63-a09a-29fa01243f3e-kube-api-access-llqpt\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:16.903943 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.903915    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44jv9\" (UniqueName: \"kubernetes.io/projected/6bce79ad-13fe-4feb-a06c-394b87713f64-kube-api-access-44jv9\") pod \"node-ca-hfwxg\" (UID: \"6bce79ad-13fe-4feb-a06c-394b87713f64\") " pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:16.942209 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.942177    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:16.981611 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.981580    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lsxw"
May 25 01:02:16.992291 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:16.992271    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:17.000952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.000928    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x"
May 25 01:02:17.006525 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.006509    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wrq4z"
May 25 01:02:17.014091 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.014070    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82jwn"
May 25 01:02:17.021653 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.021634    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tn97q"
May 25 01:02:17.030238 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.030220    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8zkg"
May 25 01:02:17.039766 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.039751    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hfwxg"
May 25 01:02:17.045313 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.045296    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:17.297059 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.296985    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:17.297208 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.297091    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:17.297208 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.297104    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:17.297208 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.297113    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:17.297208 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.297160    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:18.297146698 +0000 UTC m=+4.087353283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:17.397340 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.397310    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:17.397512 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.397463    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:17.397574 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.397528    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:18.397508826 +0000 UTC m=+4.187715410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:17.448465 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.448330    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9183920_32a1_4962_8487_5bc7818d4356.slice/crio-b2eeabc1ef616cd470365f5c239015f8c060aa55de75e415af29671fddf9298e WatchSource:0}: Error finding container b2eeabc1ef616cd470365f5c239015f8c060aa55de75e415af29671fddf9298e: Status 404 returned error can't find the container with id b2eeabc1ef616cd470365f5c239015f8c060aa55de75e415af29671fddf9298e
May 25 01:02:17.449556 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.449527    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07506dc2_14a3_4361_b1a1_6f755828fd8b.slice/crio-ee3b05f6a67fc23f2beb2d37d6c6d0bbe760596d21dd41d936505e19e4a6c72a WatchSource:0}: Error finding container ee3b05f6a67fc23f2beb2d37d6c6d0bbe760596d21dd41d936505e19e4a6c72a: Status 404 returned error can't find the container with id ee3b05f6a67fc23f2beb2d37d6c6d0bbe760596d21dd41d936505e19e4a6c72a
May 25 01:02:17.452735 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.452715    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5880d7_8d6f_4a98_869b_0363a11b2398.slice/crio-9ba82a25c008aff4c1afebaf64f146dae7d1233df24af23a28ecf46fb6a1d801 WatchSource:0}: Error finding container 9ba82a25c008aff4c1afebaf64f146dae7d1233df24af23a28ecf46fb6a1d801: Status 404 returned error can't find the container with id 9ba82a25c008aff4c1afebaf64f146dae7d1233df24af23a28ecf46fb6a1d801
May 25 01:02:17.453515 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.453492    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bce79ad_13fe_4feb_a06c_394b87713f64.slice/crio-a5bdb54bd4191bacf4e0438f3a220dc60b82ecd68cdf5e7f7813cb5d641b1181 WatchSource:0}: Error finding container a5bdb54bd4191bacf4e0438f3a220dc60b82ecd68cdf5e7f7813cb5d641b1181: Status 404 returned error can't find the container with id a5bdb54bd4191bacf4e0438f3a220dc60b82ecd68cdf5e7f7813cb5d641b1181
May 25 01:02:17.454362 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.454338    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b44482d_18d6_448e_a580_da06c5e9e72a.slice/crio-7ef4b8ec0682686bf63771bcd89ac1ac7ade8f83e0c7f129fbfb46a46077d475 WatchSource:0}: Error finding container 7ef4b8ec0682686bf63771bcd89ac1ac7ade8f83e0c7f129fbfb46a46077d475: Status 404 returned error can't find the container with id 7ef4b8ec0682686bf63771bcd89ac1ac7ade8f83e0c7f129fbfb46a46077d475
May 25 01:02:17.455209 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.455184    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a7f20d_75f0_456d_a415_15cb8ca7adb3.slice/crio-836577b943868ec36497f33d958b361ff35eac5dd40fe6442a0d53f453439938 WatchSource:0}: Error finding container 836577b943868ec36497f33d958b361ff35eac5dd40fe6442a0d53f453439938: Status 404 returned error can't find the container with id 836577b943868ec36497f33d958b361ff35eac5dd40fe6442a0d53f453439938
May 25 01:02:17.457527 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.457249    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32d2fe2_8269_4821_a1d1_8e5660df3c06.slice/crio-b1f008dd3ca1f5175a10dd3e8254ddc020c6214747369ddbf3ecb2dcdd4bd08d WatchSource:0}: Error finding container b1f008dd3ca1f5175a10dd3e8254ddc020c6214747369ddbf3ecb2dcdd4bd08d: Status 404 returned error can't find the container with id b1f008dd3ca1f5175a10dd3e8254ddc020c6214747369ddbf3ecb2dcdd4bd08d
May 25 01:02:17.457668 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.457647    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea42f20_679e_47ed_934d_750480d95a60.slice/crio-f41a8e8beb1fdec8cc48a7edaf244c0ebf78cce69b3ea6e540af2c2093431e1b WatchSource:0}: Error finding container f41a8e8beb1fdec8cc48a7edaf244c0ebf78cce69b3ea6e540af2c2093431e1b: Status 404 returned error can't find the container with id f41a8e8beb1fdec8cc48a7edaf244c0ebf78cce69b3ea6e540af2c2093431e1b
May 25 01:02:17.458617 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:17.458600    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2140cd91_dd9d_49b9_b9fb_7ec7caa5656e.slice/crio-694a35565908e8e0b8e978e339fbf16ba797fb6765a9239ddb68890862178afb WatchSource:0}: Error finding container 694a35565908e8e0b8e978e339fbf16ba797fb6765a9239ddb68890862178afb: Status 404 returned error can't find the container with id 694a35565908e8e0b8e978e339fbf16ba797fb6765a9239ddb68890862178afb
May 25 01:02:17.718657 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.718501    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:15 +0000 UTC" deadline="2027-11-15 20:22:21.08408416 +0000 UTC"
May 25 01:02:17.718657 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.718656    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12955h20m3.36543186s"
May 25 01:02:17.767690 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.767666    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:17.767798 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:17.767760    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:17.775277 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.775254    2575 generic.go:358] "Generic (PLEG): container finished" podID="7b7bd44152f743cc1e5b6a72329980bb" containerID="7255c41ff5d3f4908238ac5c723f2ae634a12722308ddf6ed9a462ee769d871b" exitCode=0
May 25 01:02:17.775375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.775320    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"7b7bd44152f743cc1e5b6a72329980bb","Type":"ContainerDied","Data":"7255c41ff5d3f4908238ac5c723f2ae634a12722308ddf6ed9a462ee769d871b"}
May 25 01:02:17.776367 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.776344    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"694a35565908e8e0b8e978e339fbf16ba797fb6765a9239ddb68890862178afb"}
May 25 01:02:17.777287 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.777263    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8zkg" event={"ID":"b0a7f20d-75f0-456d-a415-15cb8ca7adb3","Type":"ContainerStarted","Data":"836577b943868ec36497f33d958b361ff35eac5dd40fe6442a0d53f453439938"}
May 25 01:02:17.778170 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.778151    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lsxw" event={"ID":"07506dc2-14a3-4361-b1a1-6f755828fd8b","Type":"ContainerStarted","Data":"ee3b05f6a67fc23f2beb2d37d6c6d0bbe760596d21dd41d936505e19e4a6c72a"}
May 25 01:02:17.779483 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.779456    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" event={"ID":"9967a8879fa48b19b7c0f1227c168553","Type":"ContainerStarted","Data":"aab9005a1c2a7695a0d0063121efe75ede4396b5e42b2adce97d615f64aff3ae"}
May 25 01:02:17.780425 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.780399    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qtxsg" event={"ID":"8ea42f20-679e-47ed-934d-750480d95a60","Type":"ContainerStarted","Data":"f41a8e8beb1fdec8cc48a7edaf244c0ebf78cce69b3ea6e540af2c2093431e1b"}
May 25 01:02:17.781368 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.781341    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tn97q" event={"ID":"a32d2fe2-8269-4821-a1d1-8e5660df3c06","Type":"ContainerStarted","Data":"b1f008dd3ca1f5175a10dd3e8254ddc020c6214747369ddbf3ecb2dcdd4bd08d"}
May 25 01:02:17.782194 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.782173    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82jwn" event={"ID":"4b44482d-18d6-448e-a580-da06c5e9e72a","Type":"ContainerStarted","Data":"7ef4b8ec0682686bf63771bcd89ac1ac7ade8f83e0c7f129fbfb46a46077d475"}
May 25 01:02:17.783034 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.783013    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hfwxg" event={"ID":"6bce79ad-13fe-4feb-a06c-394b87713f64","Type":"ContainerStarted","Data":"a5bdb54bd4191bacf4e0438f3a220dc60b82ecd68cdf5e7f7813cb5d641b1181"}
May 25 01:02:17.783862 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.783845    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x" event={"ID":"0c5880d7-8d6f-4a98-869b-0363a11b2398","Type":"ContainerStarted","Data":"9ba82a25c008aff4c1afebaf64f146dae7d1233df24af23a28ecf46fb6a1d801"}
May 25 01:02:17.784814 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.784794    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerStarted","Data":"b2eeabc1ef616cd470365f5c239015f8c060aa55de75e415af29671fddf9298e"}
May 25 01:02:17.802428 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:17.802392    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-62.ec2.internal" podStartSLOduration=1.802381763 podStartE2EDuration="1.802381763s" podCreationTimestamp="2026-05-25 01:02:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:17.801901663 +0000 UTC m=+3.592108270" watchObservedRunningTime="2026-05-25 01:02:17.802381763 +0000 UTC m=+3.592588370"
May 25 01:02:18.214135 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.213501    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:18.304595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.304550    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:18.304788 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.304749    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:18.304788 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.304781    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:18.304902 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.304795    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:18.304902 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.304876    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:20.304854338 +0000 UTC m=+6.095060945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:18.405014 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.404932    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:18.405194 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.405097    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:18.405194 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.405168    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:20.405148818 +0000 UTC m=+6.195355405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:18.772623 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.771974    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:18.772623 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:18.772153    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:18.811393 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.811344    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" event={"ID":"7b7bd44152f743cc1e5b6a72329980bb","Type":"ContainerStarted","Data":"1b4e54be2924e1d70660f779f3e5c8214f006bdd88e1700ed4a4c1665f8cf6c9"}
May 25 01:02:18.824670 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:18.824300    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-62.ec2.internal" podStartSLOduration=2.824282159 podStartE2EDuration="2.824282159s" podCreationTimestamp="2026-05-25 01:02:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:18.823472672 +0000 UTC m=+4.613679282" watchObservedRunningTime="2026-05-25 01:02:18.824282159 +0000 UTC m=+4.614488767"
May 25 01:02:19.768719 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:19.768245    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:19.768719 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:19.768368    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:20.325717 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:20.325109    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:20.325717 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.325286    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:20.325717 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.325304    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:20.325717 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.325316    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:20.325717 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.325374    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.325356342 +0000 UTC m=+10.115562931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:20.426472 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:20.426398    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:20.426648 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.426577    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:20.426648 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.426639    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.426620794 +0000 UTC m=+10.216827383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:20.767915 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:20.767835    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:20.768064 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:20.767980    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:21.768076 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:21.768045    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:21.768522 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:21.768170    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:22.007800 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.007608    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dgd8t"]
May 25 01:02:22.015556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.015163    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.015556 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.015248    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:22.139170 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.138988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-dbus\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.139170 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.139079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.139170 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.139128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-kubelet-config\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240240 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.240176    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-dbus\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240394 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.240247    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240394 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.240285    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-kubelet-config\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240504 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.240398    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-kubelet-config\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.240534    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-dbus\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.240671 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.240636    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:22.240749 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.240711    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:22.740682693 +0000 UTC m=+8.530889295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:22.744379 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.744340    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:22.744579 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.744480    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:22.744579 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.744541    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:23.74452691 +0000 UTC m=+9.534733496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:22.768179 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:22.768148    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:22.768546 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:22.768310    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:23.753347 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:23.753305    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:23.753541 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:23.753489    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:23.753605 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:23.753552    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:25.753533091 +0000 UTC m=+11.543739680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:23.767424 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:23.767268    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:23.767424 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:23.767274    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:23.767424 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:23.767402    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:23.767676 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:23.767481    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:24.360012 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:24.359454    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:24.360012 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.359623    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:24.360012 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.359642    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:24.360012 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.359654    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:24.360012 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.359709    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:32.359689788 +0000 UTC m=+18.149896378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:24.460469 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:24.460425    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:24.460647 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.460576    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:24.460647 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.460636    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:32.460619593 +0000 UTC m=+18.250826192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:24.769882 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:24.769809    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:24.770062 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:24.769932    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:25.767441 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:25.767407    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:25.767922 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:25.767462    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:25.767922 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:25.767548    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:25.767922 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:25.767675    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:25.769639 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:25.769564    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:25.769765 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:25.769719    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:25.769847 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:25.769798    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:29.769763865 +0000 UTC m=+15.559970450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:26.770652 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:26.770621    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:26.771112 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:26.770754    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:27.768176 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:27.768148    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:27.768330 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:27.768267    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:27.768330 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:27.768309    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:27.768446 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:27.768382    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:28.767868 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:28.767829    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:28.768299 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:28.767962    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:29.767885 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:29.767852    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:29.768316 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:29.767854    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:29.768316 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:29.767967    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:29.768316 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:29.768041    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:29.801811 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:29.801755    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:29.801985 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:29.801905    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:29.801985 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:29.801960    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:37.801947354 +0000 UTC m=+23.592153938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:30.768025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:30.767992    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:30.768465 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:30.768125    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:31.767423 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:31.767385    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:31.767743 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:31.767386    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:31.767743 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:31.767519    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:31.767743 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:31.767599    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:32.422922 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:32.422885    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:32.423417 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.423057    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:32.423417 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.423084    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:32.423417 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.423099    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:32.423417 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.423164    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:48.423142944 +0000 UTC m=+34.213349533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:32.523985 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:32.523941    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:32.524169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.524107    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.524228 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.524183    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:48.524163977 +0000 UTC m=+34.314370563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:32.767790 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:32.767699    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:32.767938 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:32.767861    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:33.767966 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:33.767930    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:33.768419 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:33.767931    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:33.768419 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:33.768049    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:33.768419 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:33.768127    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:34.768003 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:34.767972    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:34.768478 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:34.768089    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:35.768201 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:35.768164    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:35.768636 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:35.768169    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:35.768636 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:35.768265    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:35.768636 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:35.768340    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:36.768432 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.768210    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:36.769087 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:36.768479    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:36.844479 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.844358    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lsxw" event={"ID":"07506dc2-14a3-4361-b1a1-6f755828fd8b","Type":"ContainerStarted","Data":"0bdc75489a71a4b5f503a3851aecc3850f038ce2af7564c1bc5ccd85721d5305"}
May 25 01:02:36.845827 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.845799    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qtxsg" event={"ID":"8ea42f20-679e-47ed-934d-750480d95a60","Type":"ContainerStarted","Data":"3f6ac3d623256bdbff49283393930e0d74aa00c9beb5fe906e9c350880bceed3"}
May 25 01:02:36.847156 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.847127    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tn97q" event={"ID":"a32d2fe2-8269-4821-a1d1-8e5660df3c06","Type":"ContainerStarted","Data":"038fb26560cc6c09c1d83e259471bb1e12d372e0617dce6c5e83fa4fc9efe20f"}
May 25 01:02:36.849076 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.849042    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82jwn" event={"ID":"4b44482d-18d6-448e-a580-da06c5e9e72a","Type":"ContainerStarted","Data":"e42a57052d91f416fd4fe7e0845592e400da01e997703ddf0aaf0df82fc3a454"}
May 25 01:02:36.853107 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.853087    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hfwxg" event={"ID":"6bce79ad-13fe-4feb-a06c-394b87713f64","Type":"ContainerStarted","Data":"11c3f1e86f0bb38e231f27f7c504792328c6f5df568b4682fc2c24cd890a1414"}
May 25 01:02:36.854531 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.854510    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x" event={"ID":"0c5880d7-8d6f-4a98-869b-0363a11b2398","Type":"ContainerStarted","Data":"478d4a79279914d8f08d6128f51ea07be9289eb87dd3534f969646e33dc31e6f"}
May 25 01:02:36.855870 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.855841    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="51ceb66e2899d95c2ead1c5a0f1a88f52debbd6b0a973182a193ced96638e7ec" exitCode=0
May 25 01:02:36.855943 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.855912    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"51ceb66e2899d95c2ead1c5a0f1a88f52debbd6b0a973182a193ced96638e7ec"}
May 25 01:02:36.870208 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870179    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"df8041f61d7c1380d9b6aa0ac3d024e7841436e765779bc953c3fe621bf26ca6"}
May 25 01:02:36.870323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870213    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"bf66213f11a1c3d8c82d095a354c4974453f3907fc6f3f637afd2380891434cf"}
May 25 01:02:36.870323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870226    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"dbbfd2b5b31c0b883f955c1a9266ea5722b0a09003b70a0db08c44c65e842f16"}
May 25 01:02:36.870323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870239    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"5cc8ba5ab883aa94d52a0660e6f27ef49f60dfa477f3be29e39911765fa62873"}
May 25 01:02:36.870323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870251    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"e02937281069aafb7e806e5ddfa60262bcc9a77dcc1d6cee0a9f51fec1836caa"}
May 25 01:02:36.870323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.870262    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"6434842f8aa94ac344bc2e3305c399cad7e2dbd9e0928c2c5dd204134516cbda"}
May 25 01:02:36.876556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.876521    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lsxw" podStartSLOduration=4.533072342 podStartE2EDuration="22.876509935s" podCreationTimestamp="2026-05-25 01:02:14 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.451684844 +0000 UTC m=+3.241891433" lastFinishedPulling="2026-05-25 01:02:35.795122432 +0000 UTC m=+21.585329026" observedRunningTime="2026-05-25 01:02:36.875953765 +0000 UTC m=+22.666160374" watchObservedRunningTime="2026-05-25 01:02:36.876509935 +0000 UTC m=+22.666716541"
May 25 01:02:36.916485 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.916440    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qtxsg" podStartSLOduration=8.517994614 podStartE2EDuration="22.916430985s" podCreationTimestamp="2026-05-25 01:02:14 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.481600511 +0000 UTC m=+3.271807096" lastFinishedPulling="2026-05-25 01:02:31.880036864 +0000 UTC m=+17.670243467" observedRunningTime="2026-05-25 01:02:36.893402902 +0000 UTC m=+22.683609510" watchObservedRunningTime="2026-05-25 01:02:36.916430985 +0000 UTC m=+22.706637592"
May 25 01:02:36.916728 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.916703    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-82jwn" podStartSLOduration=3.547495043 podStartE2EDuration="21.916696458s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.456208726 +0000 UTC m=+3.246415315" lastFinishedPulling="2026-05-25 01:02:35.825410142 +0000 UTC m=+21.615616730" observedRunningTime="2026-05-25 01:02:36.916298309 +0000 UTC m=+22.706504915" watchObservedRunningTime="2026-05-25 01:02:36.916696458 +0000 UTC m=+22.706903067"
May 25 01:02:36.957639 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.957587    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tn97q" podStartSLOduration=3.645393334 podStartE2EDuration="21.957575277s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.481636775 +0000 UTC m=+3.271843372" lastFinishedPulling="2026-05-25 01:02:35.793818718 +0000 UTC m=+21.584025315" observedRunningTime="2026-05-25 01:02:36.957176023 +0000 UTC m=+22.747382629" watchObservedRunningTime="2026-05-25 01:02:36.957575277 +0000 UTC m=+22.747781885"
May 25 01:02:36.970749 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:36.970712    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hfwxg" podStartSLOduration=11.82378088 podStartE2EDuration="21.970699524s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.455318219 +0000 UTC m=+3.245524811" lastFinishedPulling="2026-05-25 01:02:27.60223687 +0000 UTC m=+13.392443455" observedRunningTime="2026-05-25 01:02:36.970354556 +0000 UTC m=+22.760561162" watchObservedRunningTime="2026-05-25 01:02:36.970699524 +0000 UTC m=+22.760906131"
May 25 01:02:37.380022 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.380001    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 01:02:37.757353 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.757239    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T01:02:37.380018963Z","UUID":"5688cd36-f71d-4429-b9bc-b15790c36e24","Handler":null,"Name":"","Endpoint":""}
May 25 01:02:37.759023 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.759003    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 01:02:37.759136 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.759031    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 01:02:37.767945 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.767920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:37.768056 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.767920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:37.768056 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:37.768043    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:37.768161 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:37.768150    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:37.863338 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.863294    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:37.863809 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:37.863434    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:37.863809 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:37.863521    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret podName:3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e nodeName:}" failed. No retries permitted until 2026-05-25 01:02:53.863500601 +0000 UTC m=+39.653707207 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret") pod "global-pull-secret-syncer-dgd8t" (UID: "3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:37.874378 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.874335    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x" event={"ID":"0c5880d7-8d6f-4a98-869b-0363a11b2398","Type":"ContainerStarted","Data":"83b3d9ed3f5cf561719ff5875a100ebf1152f60eeab4e518ccf03cc936f7e4c2"}
May 25 01:02:37.875897 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.875845    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8zkg" event={"ID":"b0a7f20d-75f0-456d-a415-15cb8ca7adb3","Type":"ContainerStarted","Data":"1e75608dff26510121a7b938ca4e6403a146765e506d97a947fabb8ab997425a"}
May 25 01:02:37.892348 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:37.892297    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8zkg" podStartSLOduration=4.555569567 podStartE2EDuration="22.892280151s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.457112199 +0000 UTC m=+3.247318790" lastFinishedPulling="2026-05-25 01:02:35.793822786 +0000 UTC m=+21.584029374" observedRunningTime="2026-05-25 01:02:37.891953497 +0000 UTC m=+23.682160106" watchObservedRunningTime="2026-05-25 01:02:37.892280151 +0000 UTC m=+23.682486759"
May 25 01:02:38.767593 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:38.767559    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:38.767743 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:38.767709    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:38.880012 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:38.879789    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x" event={"ID":"0c5880d7-8d6f-4a98-869b-0363a11b2398","Type":"ContainerStarted","Data":"0278edbf2af3a94fca2049cb823eb61aaadeadae09d5525e7d475e603d4274ec"}
May 25 01:02:38.883437 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:38.883403    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"ff555b6e8feb3fe72429478559c334ab2615fa48d437fa405ba30e541d8e10ae"}
May 25 01:02:38.900203 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:38.900103    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bxv6x" podStartSLOduration=3.969056294 podStartE2EDuration="24.900086821s" podCreationTimestamp="2026-05-25 01:02:14 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.45435494 +0000 UTC m=+3.244561525" lastFinishedPulling="2026-05-25 01:02:38.385385467 +0000 UTC m=+24.175592052" observedRunningTime="2026-05-25 01:02:38.898816604 +0000 UTC m=+24.689023212" watchObservedRunningTime="2026-05-25 01:02:38.900086821 +0000 UTC m=+24.690293431"
May 25 01:02:39.229252 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:39.229173    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:39.767619 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:39.767591    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:39.767838 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:39.767593    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:39.767838 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:39.767714    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:39.767838 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:39.767801    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:40.767792 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:40.767749    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:40.768285 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:40.767904    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:41.626500 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.626276    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:41.627258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.627243    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:41.767992 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.767952    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:41.768734 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.767952    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:41.768734 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:41.768076    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:41.768734 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:41.768106    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:41.890055 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.889968    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="2ad3140994008aa2511176746dd4a0365eb90279347c270af53d90ae1b56b042" exitCode=0
May 25 01:02:41.890055 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.890038    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"2ad3140994008aa2511176746dd4a0365eb90279347c270af53d90ae1b56b042"}
May 25 01:02:41.893267 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.893235    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" event={"ID":"2140cd91-dd9d-49b9-b9fb-7ec7caa5656e","Type":"ContainerStarted","Data":"09536072ce8d9b4a75a6a910f9ec6561507d69f131058f9318eb146008ae130c"}
May 25 01:02:41.893618 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.893564    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:41.893618 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.893595    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:41.894017 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.893994    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qtxsg"
May 25 01:02:41.908557 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.908532    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:41.908693 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.908612    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:41.960719 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:41.960653    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx" podStartSLOduration=8.472738873 podStartE2EDuration="26.960639081s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.481604111 +0000 UTC m=+3.271810710" lastFinishedPulling="2026-05-25 01:02:35.969504322 +0000 UTC m=+21.759710918" observedRunningTime="2026-05-25 01:02:41.960146102 +0000 UTC m=+27.750352708" watchObservedRunningTime="2026-05-25 01:02:41.960639081 +0000 UTC m=+27.750845687"
May 25 01:02:42.767819 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:42.767767    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:42.768029 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:42.767933    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:42.896467 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:42.896437    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="298db7ac02f9d878b40ce632b3806da3245e01118ce42fd7bd38df8f87af66ac" exitCode=0
May 25 01:02:42.896626 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:42.896546    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"298db7ac02f9d878b40ce632b3806da3245e01118ce42fd7bd38df8f87af66ac"}
May 25 01:02:42.896818 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:42.896808    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 25 01:02:43.022218 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.022186    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dgd8t"]
May 25 01:02:43.022373 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.022272    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:43.024800 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:43.022361    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:43.026347 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.026311    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zghqp"]
May 25 01:02:43.026465 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.026432    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:43.026560 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:43.026539    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:43.031164 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.031146    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbzpv"]
May 25 01:02:43.031258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.031236    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:43.031352 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:43.031320    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:43.900595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.900563    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="06dc37f58db5132600e76b1e1ad61ca6eda2d23466abba4de27716d28f0dd99c" exitCode=0
May 25 01:02:43.901070 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.900611    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"06dc37f58db5132600e76b1e1ad61ca6eda2d23466abba4de27716d28f0dd99c"}
May 25 01:02:43.901070 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:43.900864    2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 25 01:02:44.082473 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:44.082445    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:02:44.768492 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:44.768456    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:44.768669 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:44.768572    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:44.768669 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:44.768603    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:44.768669 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:44.768628    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:44.768845 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:44.768709    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:44.768845 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:44.768813    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:46.768249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:46.767935    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:46.768686 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:46.767968    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:46.768686 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:46.768362    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbzpv" podUID="b96715e1-a842-433d-89ac-aa1b65f48003"
May 25 01:02:46.768686 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:46.767992    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:46.768686 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:46.768440    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dgd8t" podUID="3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e"
May 25 01:02:46.768686 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:46.768539    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:02:48.448649 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.448615    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:48.449144 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.448765    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:48.449144 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.448797    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:48.449144 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.448806    2575 projected.go:194] Error preparing data for projected volume kube-api-access-kmg42 for pod openshift-network-diagnostics/network-check-target-lbzpv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:48.449144 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.448856    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42 podName:b96715e1-a842-433d-89ac-aa1b65f48003 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:20.448843737 +0000 UTC m=+66.239050322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmg42" (UniqueName: "kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42") pod "network-check-target-lbzpv" (UID: "b96715e1-a842-433d-89ac-aa1b65f48003") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:48.549605 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.549567    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:48.549796 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.549732    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:48.549871 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.549821    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:03:20.549800806 +0000 UTC m=+66.340007390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:48.576736 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.576672    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-62.ec2.internal" event="NodeReady"
May 25 01:02:48.576936 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.576833    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 01:02:48.618721 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.618687    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"]
May 25 01:02:48.658629 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.658555    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"]
May 25 01:02:48.658815 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.658766    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.661710 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.661690    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 25 01:02:48.662161 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.662143    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 25 01:02:48.662327 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.662306    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 25 01:02:48.662522 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.662507    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 25 01:02:48.662737 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.662717    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 25 01:02:48.662737 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.662734    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 25 01:02:48.663191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.663171    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 25 01:02:48.673185 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.673118    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:02:48.673284 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.673215    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.676290 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.676273    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2mtbd\""
May 25 01:02:48.676729 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.676712    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 25 01:02:48.687820 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.687804    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"]
May 25 01:02:48.687909 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.687894    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.690845 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.690826    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8cjkp\""
May 25 01:02:48.691102 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.691074    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 01:02:48.691276 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.691260    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 01:02:48.691413 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.691395    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 01:02:48.697679 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.697663    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 01:02:48.703886 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.703860    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"]
May 25 01:02:48.703975 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.703898    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w2n7v"]
May 25 01:02:48.703975 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.703901    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.706621 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.706603    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 25 01:02:48.717951 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.717921    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84nsk"]
May 25 01:02:48.718074 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.718059    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.721671 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.721655    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 01:02:48.721837 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.721820    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:02:48.722253 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.722238    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 01:02:48.731930 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.731911    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"]
May 25 01:02:48.732027 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.731940    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"]
May 25 01:02:48.732027 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.731953    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:02:48.732027 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.731964    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84nsk"]
May 25 01:02:48.732027 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.731975    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2n7v"]
May 25 01:02:48.732195 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.732080    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.735364 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.735346    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 01:02:48.735473 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.735363    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 01:02:48.735473 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.735350    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 01:02:48.735473 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.735431    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:02:48.751273 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.751375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq965\" (UniqueName: \"kubernetes.io/projected/67261157-628b-43bb-afd9-b3286a5d6a8f-kube-api-access-nq965\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.751375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/67261157-628b-43bb-afd9-b3286a5d6a8f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.751375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.751375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.751561 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.751463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.767906 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.767884    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:02:48.768016 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.767882    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:48.768081 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.768018    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:02:48.771866 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.771849    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:02:48.771994 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.771978    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 01:02:48.772191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.772117    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:02:48.772191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.772134    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:02:48.772191 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.772183    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:02:48.772386 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.772198    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:02:48.852561 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852474    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.852561 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5c2\" (UniqueName: \"kubernetes.io/projected/c5ca3a91-e04d-4d2e-8677-90357d07d24d-kube-api-access-nl5c2\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.852561 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852558    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4p4m\" (UniqueName: \"kubernetes.io/projected/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-kube-api-access-h4p4m\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852636    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29884ebe-3b09-4887-8101-7e6249c49ca2-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27mkd\" (UniqueName: \"kubernetes.io/projected/29884ebe-3b09-4887-8101-7e6249c49ca2-kube-api-access-27mkd\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.852813 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ca3a91-e04d-4d2e-8677-90357d07d24d-config-volume\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852823    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nq965\" (UniqueName: \"kubernetes.io/projected/67261157-628b-43bb-afd9-b3286a5d6a8f-kube-api-access-nq965\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852840    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mk4s\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852953    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/67261157-628b-43bb-afd9-b3286a5d6a8f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.852991    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853062    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29884ebe-3b09-4887-8101-7e6249c49ca2-tmp\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ca3a91-e04d-4d2e-8677-90357d07d24d-tmp-dir\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853226    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.853411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76d2\" (UniqueName: \"kubernetes.io/projected/b9d37131-d722-441a-9bbd-1eab6d47194b-kube-api-access-t76d2\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.853727 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.853612    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/67261157-628b-43bb-afd9-b3286a5d6a8f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.857549 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.857525    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.857667 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.857555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.857667 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.857524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-ca\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.857667 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.857527    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67261157-628b-43bb-afd9-b3286a5d6a8f-hub\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.867907 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.867884    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq965\" (UniqueName: \"kubernetes.io/projected/67261157-628b-43bb-afd9-b3286a5d6a8f-kube-api-access-nq965\") pod \"cluster-proxy-proxy-agent-86d6966d6b-8zbdm\" (UID: \"67261157-628b-43bb-afd9-b3286a5d6a8f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.954014 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.953976    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.954014 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954020    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29884ebe-3b09-4887-8101-7e6249c49ca2-tmp\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954044    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954064    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954090    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ca3a91-e04d-4d2e-8677-90357d07d24d-tmp-dir\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954117    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954143    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954168    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954181    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:48.954258 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954252    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:02:49.454229895 +0000 UTC m=+35.244436495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954190    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t76d2\" (UniqueName: \"kubernetes.io/projected/b9d37131-d722-441a-9bbd-1eab6d47194b-kube-api-access-t76d2\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954438    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29884ebe-3b09-4887-8101-7e6249c49ca2-tmp\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954443    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954511    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5c2\" (UniqueName: \"kubernetes.io/projected/c5ca3a91-e04d-4d2e-8677-90357d07d24d-kube-api-access-nl5c2\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954528    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954532    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954543    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954555    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954594    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:49.454576687 +0000 UTC m=+35.244783284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954620    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4p4m\" (UniqueName: \"kubernetes.io/projected/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-kube-api-access-h4p4m\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5ca3a91-e04d-4d2e-8677-90357d07d24d-tmp-dir\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.954663 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:48.954667    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:02:49.454657024 +0000 UTC m=+35.244863617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954686    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29884ebe-3b09-4887-8101-7e6249c49ca2-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954715    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27mkd\" (UniqueName: \"kubernetes.io/projected/29884ebe-3b09-4887-8101-7e6249c49ca2-kube-api-access-27mkd\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954739    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ca3a91-e04d-4d2e-8677-90357d07d24d-config-volume\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954827    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954861    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mk4s\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.955269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.954916    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.955555 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.955323    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ca3a91-e04d-4d2e-8677-90357d07d24d-config-volume\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.955555 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.955441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.955659 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.955579    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.955716 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.955688    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.957392 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.957366    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.957637 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.957615    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.957755 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.957737    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29884ebe-3b09-4887-8101-7e6249c49ca2-klusterlet-config\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.957849 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.957827    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.963661 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.963615    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27mkd\" (UniqueName: \"kubernetes.io/projected/29884ebe-3b09-4887-8101-7e6249c49ca2-kube-api-access-27mkd\") pod \"klusterlet-addon-workmgr-f7d456474-k2n4v\" (UID: \"29884ebe-3b09-4887-8101-7e6249c49ca2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:48.964024 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.963974    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4p4m\" (UniqueName: \"kubernetes.io/projected/db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c-kube-api-access-h4p4m\") pod \"managed-serviceaccount-addon-agent-78556f4946-5csvd\" (UID: \"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:48.964437 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.964301    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.964815 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.964764    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76d2\" (UniqueName: \"kubernetes.io/projected/b9d37131-d722-441a-9bbd-1eab6d47194b-kube-api-access-t76d2\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:48.965767 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.965748    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mk4s\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:48.965922 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.965854    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5c2\" (UniqueName: \"kubernetes.io/projected/c5ca3a91-e04d-4d2e-8677-90357d07d24d-kube-api-access-nl5c2\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:48.978035 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.978016    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:02:48.986715 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:48.986697    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:02:49.014492 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:49.014467    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:49.459143 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:49.459106    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:49.459156    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:49.459186    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459294    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459308    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459315    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459362    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459378    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:50.459356883 +0000 UTC m=+36.249563490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459396    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:02:50.459387056 +0000 UTC m=+36.249593641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:02:49.459674 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:49.459495    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:02:50.459476317 +0000 UTC m=+36.249682907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:02:50.056803 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.056763    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"]
May 25 01:02:50.060031 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.060006    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"]
May 25 01:02:50.060492 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:50.060468    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29884ebe_3b09_4887_8101_7e6249c49ca2.slice/crio-5a3a638887cedc99e55b350b6e329568ab3ffa4a5401a4a8b6cb20883c3813a7 WatchSource:0}: Error finding container 5a3a638887cedc99e55b350b6e329568ab3ffa4a5401a4a8b6cb20883c3813a7: Status 404 returned error can't find the container with id 5a3a638887cedc99e55b350b6e329568ab3ffa4a5401a4a8b6cb20883c3813a7
May 25 01:02:50.061050 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.061032    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"]
May 25 01:02:50.063404 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:50.063380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67261157_628b_43bb_afd9_b3286a5d6a8f.slice/crio-f09ce77cf73eb1d003ad736dc0c9f47c7d9459a3fb0131784f5cbc81c85ebe15 WatchSource:0}: Error finding container f09ce77cf73eb1d003ad736dc0c9f47c7d9459a3fb0131784f5cbc81c85ebe15: Status 404 returned error can't find the container with id f09ce77cf73eb1d003ad736dc0c9f47c7d9459a3fb0131784f5cbc81c85ebe15
May 25 01:02:50.066416 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:50.066200    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb57c39d_4e4f_4b1a_b3e6_0a13caeb3f5c.slice/crio-f58216044fb31cfda6f2e453648e2d992789557ef47630c61ecd4bb2a8dc8bc8 WatchSource:0}: Error finding container f58216044fb31cfda6f2e453648e2d992789557ef47630c61ecd4bb2a8dc8bc8: Status 404 returned error can't find the container with id f58216044fb31cfda6f2e453648e2d992789557ef47630c61ecd4bb2a8dc8bc8
May 25 01:02:50.471207 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.471131    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:50.471207 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.471178    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:50.471207 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.471207    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471284    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471291    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471349    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:52.471334949 +0000 UTC m=+38.261541534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471349    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471373    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471363    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:02:52.471357222 +0000 UTC m=+38.261563806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:02:50.471837 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:50.471435    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:02:52.471418433 +0000 UTC m=+38.261625035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:02:50.913490 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.913454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerStarted","Data":"f09ce77cf73eb1d003ad736dc0c9f47c7d9459a3fb0131784f5cbc81c85ebe15"}
May 25 01:02:50.914598 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.914567    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v" event={"ID":"29884ebe-3b09-4887-8101-7e6249c49ca2","Type":"ContainerStarted","Data":"5a3a638887cedc99e55b350b6e329568ab3ffa4a5401a4a8b6cb20883c3813a7"}
May 25 01:02:50.917377 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.917349    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="d61a9b59ec2dbadff399ffb68f8a625175d29377a69db020781c6e3f4ced27e5" exitCode=0
May 25 01:02:50.917477 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.917423    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"d61a9b59ec2dbadff399ffb68f8a625175d29377a69db020781c6e3f4ced27e5"}
May 25 01:02:50.918546 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:50.918506    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd" event={"ID":"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c","Type":"ContainerStarted","Data":"f58216044fb31cfda6f2e453648e2d992789557ef47630c61ecd4bb2a8dc8bc8"}
May 25 01:02:51.933379 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:51.933337    2575 generic.go:358] "Generic (PLEG): container finished" podID="c9183920-32a1-4962-8487-5bc7818d4356" containerID="1bcb2acbb6167e94face6dae0220e329d154ae9da9829b2c7c0d8da8c0c4fe64" exitCode=0
May 25 01:02:51.933881 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:51.933421    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerDied","Data":"1bcb2acbb6167e94face6dae0220e329d154ae9da9829b2c7c0d8da8c0c4fe64"}
May 25 01:02:52.488526 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:52.488479    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:52.488693 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:52.488555    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:52.488693 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:52.488590    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:52.488835 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.488741    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:52.488835 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.488829    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.48880918 +0000 UTC m=+42.279015768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:02:52.489311 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.489265    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:52.489429 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.489331    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.489313845 +0000 UTC m=+42.279520437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:02:52.489429 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.489405    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:02:52.489429 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.489417    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:02:52.489582 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:52.489454    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.489441991 +0000 UTC m=+42.279648582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:02:52.941546 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:52.941508    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" event={"ID":"c9183920-32a1-4962-8487-5bc7818d4356","Type":"ContainerStarted","Data":"4ec2c8eaa1451abfc6b0cdd9e6b36666e482d078d2275ddd0b929aca41274076"}
May 25 01:02:52.968354 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:52.968289    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wrq4z" podStartSLOduration=5.374622668 podStartE2EDuration="37.968269322s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:02:17.450851151 +0000 UTC m=+3.241057738" lastFinishedPulling="2026-05-25 01:02:50.044497805 +0000 UTC m=+35.834704392" observedRunningTime="2026-05-25 01:02:52.966925737 +0000 UTC m=+38.757132345" watchObservedRunningTime="2026-05-25 01:02:52.968269322 +0000 UTC m=+38.758475929"
May 25 01:02:53.902066 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:53.902036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:53.906558 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:53.906439    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e-original-pull-secret\") pod \"global-pull-secret-syncer-dgd8t\" (UID: \"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e\") " pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:54.187508 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:54.187420    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dgd8t"
May 25 01:02:56.523406 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:56.523315    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:02:56.523406 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:56.523378    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:56.523409    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523483    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523527    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523543    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523546    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523558    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.523543333 +0000 UTC m=+50.313749918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523591    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.523575213 +0000 UTC m=+50.313781804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:02:56.523944 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:02:56.523608    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.523598725 +0000 UTC m=+50.313805314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:02:58.103872 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.103844    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dgd8t"]
May 25 01:02:58.106336 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:02:58.106307    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3288dcbd_fbb7_48c8_91d4_14f7dc09dc3e.slice/crio-4f0e283fd2b14112f39c168a633f5f55967e2f582f817d1636ce8954750455c7 WatchSource:0}: Error finding container 4f0e283fd2b14112f39c168a633f5f55967e2f582f817d1636ce8954750455c7: Status 404 returned error can't find the container with id 4f0e283fd2b14112f39c168a633f5f55967e2f582f817d1636ce8954750455c7
May 25 01:02:58.954378 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.954338    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v" event={"ID":"29884ebe-3b09-4887-8101-7e6249c49ca2","Type":"ContainerStarted","Data":"d10627c0881f5f16c7e0b166c521bd522eeb5b65e41c77010916ef1e23214c45"}
May 25 01:02:58.954578 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.954557    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:58.955427 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.955407    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dgd8t" event={"ID":"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e","Type":"ContainerStarted","Data":"4f0e283fd2b14112f39c168a633f5f55967e2f582f817d1636ce8954750455c7"}
May 25 01:02:58.956477 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.956456    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:02:58.956728 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.956708    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd" event={"ID":"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c","Type":"ContainerStarted","Data":"a00cafa5cfb8148de07f6836e2e8f71bdec08d5e8b8c687dcedb0f6ccd8e31ec"}
May 25 01:02:58.957924 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.957905    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerStarted","Data":"6ac00d322481debe8a922791183d34746d7a6528f5105778e8872eb8796c0397"}
May 25 01:02:58.973064 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:58.973023    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v" podStartSLOduration=20.042691277 podStartE2EDuration="27.973008995s" podCreationTimestamp="2026-05-25 01:02:31 +0000 UTC" firstStartedPulling="2026-05-25 01:02:50.062596414 +0000 UTC m=+35.852803012" lastFinishedPulling="2026-05-25 01:02:57.992914141 +0000 UTC m=+43.783120730" observedRunningTime="2026-05-25 01:02:58.972041281 +0000 UTC m=+44.762247889" watchObservedRunningTime="2026-05-25 01:02:58.973008995 +0000 UTC m=+44.763215604"
May 25 01:02:59.013866 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:02:59.013821    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd" podStartSLOduration=20.105024315 podStartE2EDuration="28.013807007s" podCreationTimestamp="2026-05-25 01:02:31 +0000 UTC" firstStartedPulling="2026-05-25 01:02:50.068245895 +0000 UTC m=+35.858452481" lastFinishedPulling="2026-05-25 01:02:57.977028588 +0000 UTC m=+43.767235173" observedRunningTime="2026-05-25 01:02:59.013663906 +0000 UTC m=+44.803870555" watchObservedRunningTime="2026-05-25 01:02:59.013807007 +0000 UTC m=+44.804013614"
May 25 01:03:01.966067 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:01.966022    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerStarted","Data":"de2276a5492a0536b8308630acb9bac0443b2b3356b6cc624732b5f9a7e00322"}
May 25 01:03:01.966067 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:01.966072    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerStarted","Data":"ada8bc0a938220ba2198dbb21d0f527d8361756c9cab3d43b09fef6d5a84da84"}
May 25 01:03:01.990303 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:01.990246    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" podStartSLOduration=19.975500962 podStartE2EDuration="30.990233195s" podCreationTimestamp="2026-05-25 01:02:31 +0000 UTC" firstStartedPulling="2026-05-25 01:02:50.065473164 +0000 UTC m=+35.855679753" lastFinishedPulling="2026-05-25 01:03:01.080205398 +0000 UTC m=+46.870411986" observedRunningTime="2026-05-25 01:03:01.989026317 +0000 UTC m=+47.779232958" watchObservedRunningTime="2026-05-25 01:03:01.990233195 +0000 UTC m=+47.780439802"
May 25 01:03:03.973301 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:03.973254    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dgd8t" event={"ID":"3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e","Type":"ContainerStarted","Data":"c1b431a64c867790b402f4d18d24603a18af244d17aa8ab75086e7d3aeee7cba"}
May 25 01:03:03.994713 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:03.994670    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dgd8t" podStartSLOduration=37.775169912 podStartE2EDuration="42.994655736s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:58.108135215 +0000 UTC m=+43.898341824" lastFinishedPulling="2026-05-25 01:03:03.327621056 +0000 UTC m=+49.117827648" observedRunningTime="2026-05-25 01:03:03.994351605 +0000 UTC m=+49.784558213" watchObservedRunningTime="2026-05-25 01:03:03.994655736 +0000 UTC m=+49.784862343"
May 25 01:03:04.591031 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:04.591001    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:03:04.591031 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:04.591035    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:04.591096    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591171    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591180    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591205    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591222    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:03:20.591209627 +0000 UTC m=+66.381416211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591221    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591258    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:03:20.591241257 +0000 UTC m=+66.381447856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:03:04.591305 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:04.591276    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:20.591267029 +0000 UTC m=+66.381473619 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:03:14.912496 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:14.912461    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmvhx"
May 25 01:03:20.520451 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.520409    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:03:20.523385 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.523363    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:03:20.533530 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.533509    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:03:20.544676 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.544648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmg42\" (UniqueName: \"kubernetes.io/projected/b96715e1-a842-433d-89ac-aa1b65f48003-kube-api-access-kmg42\") pod \"network-check-target-lbzpv\" (UID: \"b96715e1-a842-433d-89ac-aa1b65f48003\") " pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:03:20.595419 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.595394    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:03:20.603705 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.603685    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:03:20.621109 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.621081    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:03:20.621206 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.621154    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:03:20.621206 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.621193    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.621223    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621241    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621287    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621303    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621308    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:03:52.621287766 +0000 UTC m=+98.411494354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621335    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:20.621367 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:03:52.621329873 +0000 UTC m=+98.411536530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:03:20.621620 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.621404    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:52.62138585 +0000 UTC m=+98.411592435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:03:20.623836 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.623818    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:03:20.631666 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.631649    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:03:20.631764 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:20.631706    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:04:24.631686799 +0000 UTC m=+130.421893387 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : secret "metrics-daemon-secret" not found
May 25 01:03:20.717525 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:20.717491    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbzpv"]
May 25 01:03:20.720576 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:03:20.720546    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96715e1_a842_433d_89ac_aa1b65f48003.slice/crio-6264dc00539085fb5fe5376e693f8151ff3aafde6c0541dd90476097c2a92841 WatchSource:0}: Error finding container 6264dc00539085fb5fe5376e693f8151ff3aafde6c0541dd90476097c2a92841: Status 404 returned error can't find the container with id 6264dc00539085fb5fe5376e693f8151ff3aafde6c0541dd90476097c2a92841
May 25 01:03:21.016034 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:21.016001    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbzpv" event={"ID":"b96715e1-a842-433d-89ac-aa1b65f48003","Type":"ContainerStarted","Data":"6264dc00539085fb5fe5376e693f8151ff3aafde6c0541dd90476097c2a92841"}
May 25 01:03:25.026404 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:25.026370    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbzpv" event={"ID":"b96715e1-a842-433d-89ac-aa1b65f48003","Type":"ContainerStarted","Data":"6a7a69df0b4b8911ed87a6e5a065b161fd936de2a4dee4d593b869cac686f1fa"}
May 25 01:03:25.027446 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:25.026489    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:03:25.045685 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:25.045642    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbzpv" podStartSLOduration=67.637449518 podStartE2EDuration="1m11.045632215s" podCreationTimestamp="2026-05-25 01:02:14 +0000 UTC" firstStartedPulling="2026-05-25 01:03:20.722906314 +0000 UTC m=+66.513112903" lastFinishedPulling="2026-05-25 01:03:24.131089012 +0000 UTC m=+69.921295600" observedRunningTime="2026-05-25 01:03:25.045363407 +0000 UTC m=+70.835570014" watchObservedRunningTime="2026-05-25 01:03:25.045632215 +0000 UTC m=+70.835838821"
May 25 01:03:52.663644 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:52.663602    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:03:52.663644 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:52.663651    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:52.663676    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663767    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663812    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d45565cfd-f78wt: secret "image-registry-tls" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663871    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls podName:dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab nodeName:}" failed. No retries permitted until 2026-05-25 01:04:56.663855068 +0000 UTC m=+162.454061653 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls") pod "image-registry-d45565cfd-f78wt" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab") : secret "image-registry-tls" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663793    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663961    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert podName:b9d37131-d722-441a-9bbd-1eab6d47194b nodeName:}" failed. No retries permitted until 2026-05-25 01:04:56.663942718 +0000 UTC m=+162.454149323 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert") pod "ingress-canary-84nsk" (UID: "b9d37131-d722-441a-9bbd-1eab6d47194b") : secret "canary-serving-cert" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.663790    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:52.664169 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:03:52.664035    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls podName:c5ca3a91-e04d-4d2e-8677-90357d07d24d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:56.664017823 +0000 UTC m=+162.454224414 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls") pod "dns-default-w2n7v" (UID: "c5ca3a91-e04d-4d2e-8677-90357d07d24d") : secret "dns-default-metrics-tls" not found
May 25 01:03:56.031671 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:03:56.031641    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbzpv"
May 25 01:04:20.977241 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:20.977216    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tn97q_a32d2fe2-8269-4821-a1d1-8e5660df3c06/dns-node-resolver/0.log"
May 25 01:04:21.576696 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:21.576666    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hfwxg_6bce79ad-13fe-4feb-a06c-394b87713f64/node-ca/0.log"
May 25 01:04:24.691155 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:24.691117    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:04:24.691562 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:24.691259    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:04:24.691562 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:24.691323    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs podName:6b674d77-e2fe-4a63-a09a-29fa01243f3e nodeName:}" failed. No retries permitted until 2026-05-25 01:06:26.691308959 +0000 UTC m=+252.481515549 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs") pod "network-metrics-daemon-zghqp" (UID: "6b674d77-e2fe-4a63-a09a-29fa01243f3e") : secret "metrics-daemon-secret" not found
May 25 01:04:32.442560 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.442524    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lc5qg"]
May 25 01:04:32.444451 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.444435    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.447197 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.447179    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 01:04:32.447335 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.447180    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 01:04:32.447443 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.447428    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 01:04:32.447528 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.447431    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 01:04:32.448569 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.448556    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljdcr\""
May 25 01:04:32.459047 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.459026    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lc5qg"]
May 25 01:04:32.543208 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.543179    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b8850f-02a4-4cd4-a048-0779140cc10d-data-volume\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.543374 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.543217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.543374 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.543249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.543461 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.543387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b8850f-02a4-4cd4-a048-0779140cc10d-crio-socket\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.543461 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.543413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9qx\" (UniqueName: \"kubernetes.io/projected/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-api-access-cz9qx\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644452 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644396    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644452 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644455    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644520    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b8850f-02a4-4cd4-a048-0779140cc10d-crio-socket\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644538    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9qx\" (UniqueName: \"kubernetes.io/projected/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-api-access-cz9qx\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:32.644548    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644580    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b8850f-02a4-4cd4-a048-0779140cc10d-data-volume\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644616    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/48b8850f-02a4-4cd4-a048-0779140cc10d-crio-socket\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.644716 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:32.644622    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls podName:48b8850f-02a4-4cd4-a048-0779140cc10d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:33.144605708 +0000 UTC m=+138.934812303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc5qg" (UID: "48b8850f-02a4-4cd4-a048-0779140cc10d") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.645061 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.644953    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/48b8850f-02a4-4cd4-a048-0779140cc10d-data-volume\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.645156 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.645136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:32.677413 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:32.677387    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9qx\" (UniqueName: \"kubernetes.io/projected/48b8850f-02a4-4cd4-a048-0779140cc10d-kube-api-access-cz9qx\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:33.149249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:33.149201    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:33.149443 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:33.149348    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:33.149443 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:33.149428    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls podName:48b8850f-02a4-4cd4-a048-0779140cc10d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:34.149410552 +0000 UTC m=+139.939617136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc5qg" (UID: "48b8850f-02a4-4cd4-a048-0779140cc10d") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.158119 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:34.158089    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:34.158524 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:34.158238    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.158524 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:34.158320    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls podName:48b8850f-02a4-4cd4-a048-0779140cc10d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:36.158302862 +0000 UTC m=+141.948509462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc5qg" (UID: "48b8850f-02a4-4cd4-a048-0779140cc10d") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:36.173464 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:36.173430    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:36.173863 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:36.173567    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:36.173863 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:36.173630    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls podName:48b8850f-02a4-4cd4-a048-0779140cc10d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:40.173615161 +0000 UTC m=+145.963821746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc5qg" (UID: "48b8850f-02a4-4cd4-a048-0779140cc10d") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.209008 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:40.208954    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:40.209485 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:40.209097    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.209485 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:40.209165    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls podName:48b8850f-02a4-4cd4-a048-0779140cc10d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:48.209150274 +0000 UTC m=+153.999356859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lc5qg" (UID: "48b8850f-02a4-4cd4-a048-0779140cc10d") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:48.269927 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:48.269892    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:48.272105 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:48.272076    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/48b8850f-02a4-4cd4-a048-0779140cc10d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lc5qg\" (UID: \"48b8850f-02a4-4cd4-a048-0779140cc10d\") " pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:48.353217 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:48.353184    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lc5qg"
May 25 01:04:48.473460 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:48.473401    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lc5qg"]
May 25 01:04:48.475948 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:04:48.475918    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b8850f_02a4_4cd4_a048_0779140cc10d.slice/crio-3f2d935ee550398030b397bd5ccf1cf4f051b4c62005971e6752cc33eb7195aa WatchSource:0}: Error finding container 3f2d935ee550398030b397bd5ccf1cf4f051b4c62005971e6752cc33eb7195aa: Status 404 returned error can't find the container with id 3f2d935ee550398030b397bd5ccf1cf4f051b4c62005971e6752cc33eb7195aa
May 25 01:04:49.223003 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:49.222970    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc5qg" event={"ID":"48b8850f-02a4-4cd4-a048-0779140cc10d","Type":"ContainerStarted","Data":"16a0be76573fafb4a0b94e5bb99abac68b28166dd93bd57c784f2e1514769fcf"}
May 25 01:04:49.223003 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:49.223006    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc5qg" event={"ID":"48b8850f-02a4-4cd4-a048-0779140cc10d","Type":"ContainerStarted","Data":"3f2d935ee550398030b397bd5ccf1cf4f051b4c62005971e6752cc33eb7195aa"}
May 25 01:04:50.227089 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:50.227039    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc5qg" event={"ID":"48b8850f-02a4-4cd4-a048-0779140cc10d","Type":"ContainerStarted","Data":"59ccb959cb13656a4598194ef07e8d98993204db01c71fbd3adfe8a885def5aa"}
May 25 01:04:51.231148 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:51.231111    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lc5qg" event={"ID":"48b8850f-02a4-4cd4-a048-0779140cc10d","Type":"ContainerStarted","Data":"88f9c883adc4cfc6b7264c8388821db687eb574ff43ccc8634efb1ff9b9bffa4"}
May 25 01:04:51.254623 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:51.254579    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lc5qg" podStartSLOduration=16.746467964 podStartE2EDuration="19.254565762s" podCreationTimestamp="2026-05-25 01:04:32 +0000 UTC" firstStartedPulling="2026-05-25 01:04:48.527067223 +0000 UTC m=+154.317273811" lastFinishedPulling="2026-05-25 01:04:51.035165021 +0000 UTC m=+156.825371609" observedRunningTime="2026-05-25 01:04:51.253216851 +0000 UTC m=+157.043423458" watchObservedRunningTime="2026-05-25 01:04:51.254565762 +0000 UTC m=+157.044772368"
May 25 01:04:51.706345 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:51.706304    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"
May 25 01:04:51.727461 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:51.727429    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w2n7v" podUID="c5ca3a91-e04d-4d2e-8677-90357d07d24d"
May 25 01:04:51.741722 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:51.741698    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-84nsk" podUID="b9d37131-d722-441a-9bbd-1eab6d47194b"
May 25 01:04:51.782055 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:04:51.782016    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zghqp" podUID="6b674d77-e2fe-4a63-a09a-29fa01243f3e"
May 25 01:04:52.233705 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:52.233673    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:04:52.234172 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:52.233814    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2n7v"
May 25 01:04:56.739982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.739941    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:04:56.739982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.739988    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:04:56.740402 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.740022    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:04:56.742322 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.742284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5ca3a91-e04d-4d2e-8677-90357d07d24d-metrics-tls\") pod \"dns-default-w2n7v\" (UID: \"c5ca3a91-e04d-4d2e-8677-90357d07d24d\") " pod="openshift-dns/dns-default-w2n7v"
May 25 01:04:56.742432 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.742379    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9d37131-d722-441a-9bbd-1eab6d47194b-cert\") pod \"ingress-canary-84nsk\" (UID: \"b9d37131-d722-441a-9bbd-1eab6d47194b\") " pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:04:56.742432 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:56.742379    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"image-registry-d45565cfd-f78wt\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") " pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:04:57.039916 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.039834    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8cjkp\""
May 25 01:04:57.039916 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.039834    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:04:57.046004 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.045980    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:04:57.046149 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.046125    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2n7v"
May 25 01:04:57.172170 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.172136    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2n7v"]
May 25 01:04:57.176414 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:04:57.176384    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ca3a91_e04d_4d2e_8677_90357d07d24d.slice/crio-dcf526bb317fea2d0ca45623c67076194697788ad8421721b3873925e8feb0f7 WatchSource:0}: Error finding container dcf526bb317fea2d0ca45623c67076194697788ad8421721b3873925e8feb0f7: Status 404 returned error can't find the container with id dcf526bb317fea2d0ca45623c67076194697788ad8421721b3873925e8feb0f7
May 25 01:04:57.195315 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:04:57.195281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeca4ea_9f9a_4bae_815b_906cdd7dc6ab.slice/crio-3112e9136a3c4935fe33cda558a12b52af3299e9452e7c9c27ebe4625c528a65 WatchSource:0}: Error finding container 3112e9136a3c4935fe33cda558a12b52af3299e9452e7c9c27ebe4625c528a65: Status 404 returned error can't find the container with id 3112e9136a3c4935fe33cda558a12b52af3299e9452e7c9c27ebe4625c528a65
May 25 01:04:57.196045 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.195966    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:04:57.246606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.246578    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2n7v" event={"ID":"c5ca3a91-e04d-4d2e-8677-90357d07d24d","Type":"ContainerStarted","Data":"dcf526bb317fea2d0ca45623c67076194697788ad8421721b3873925e8feb0f7"}
May 25 01:04:57.247626 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:57.247598    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" event={"ID":"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab","Type":"ContainerStarted","Data":"3112e9136a3c4935fe33cda558a12b52af3299e9452e7c9c27ebe4625c528a65"}
May 25 01:04:58.254481 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.254447    2575 generic.go:358] "Generic (PLEG): container finished" podID="29884ebe-3b09-4887-8101-7e6249c49ca2" containerID="d10627c0881f5f16c7e0b166c521bd522eeb5b65e41c77010916ef1e23214c45" exitCode=1
May 25 01:04:58.254875 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.254515    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v" event={"ID":"29884ebe-3b09-4887-8101-7e6249c49ca2","Type":"ContainerDied","Data":"d10627c0881f5f16c7e0b166c521bd522eeb5b65e41c77010916ef1e23214c45"}
May 25 01:04:58.254875 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.254824    2575 scope.go:117] "RemoveContainer" containerID="d10627c0881f5f16c7e0b166c521bd522eeb5b65e41c77010916ef1e23214c45"
May 25 01:04:58.255890 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.255851    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" event={"ID":"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab","Type":"ContainerStarted","Data":"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"}
May 25 01:04:58.255993 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.255978    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:04:58.257209 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.257126    2575 generic.go:358] "Generic (PLEG): container finished" podID="db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c" containerID="a00cafa5cfb8148de07f6836e2e8f71bdec08d5e8b8c687dcedb0f6ccd8e31ec" exitCode=255
May 25 01:04:58.257209 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.257193    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd" event={"ID":"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c","Type":"ContainerDied","Data":"a00cafa5cfb8148de07f6836e2e8f71bdec08d5e8b8c687dcedb0f6ccd8e31ec"}
May 25 01:04:58.257561 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.257460    2575 scope.go:117] "RemoveContainer" containerID="a00cafa5cfb8148de07f6836e2e8f71bdec08d5e8b8c687dcedb0f6ccd8e31ec"
May 25 01:04:58.309623 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.309581    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" podStartSLOduration=163.30956649 podStartE2EDuration="2m43.30956649s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:58.308740376 +0000 UTC m=+164.098946982" watchObservedRunningTime="2026-05-25 01:04:58.30956649 +0000 UTC m=+164.099773096"
May 25 01:04:58.954996 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.954968    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:04:58.987130 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:58.987104    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd"
May 25 01:04:59.015266 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.015239    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:04:59.263815 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.263764    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2n7v" event={"ID":"c5ca3a91-e04d-4d2e-8677-90357d07d24d","Type":"ContainerStarted","Data":"27f70d969e0853effaa6211fb4ccdba2c02aa333c3ee20f01bf1f3bf3aee2bf7"}
May 25 01:04:59.264236 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.263823    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2n7v" event={"ID":"c5ca3a91-e04d-4d2e-8677-90357d07d24d","Type":"ContainerStarted","Data":"3e4fc3e2083635e16489ef0f8041a85f15b48431f74e9afcb26cdacd13c69b36"}
May 25 01:04:59.264236 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.263927    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w2n7v"
May 25 01:04:59.265620 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.265597    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v" event={"ID":"29884ebe-3b09-4887-8101-7e6249c49ca2","Type":"ContainerStarted","Data":"a495efa172e6e500f16d97f25a2ccde6d0b5b26551b6794e7b33cafccd3e6baa"}
May 25 01:04:59.265821 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.265798    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:04:59.267258 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.267227    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78556f4946-5csvd" event={"ID":"db57c39d-4e4f-4b1a-b3e6-0a13caeb3f5c","Type":"ContainerStarted","Data":"2a1e16c06f68f317e2d820f52bb8610a50a22cd0e46b2a465a5c1301abc46ebc"}
May 25 01:04:59.267535 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.267521    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f7d456474-k2n4v"
May 25 01:04:59.281454 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.281414    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-w2n7v" podStartSLOduration=129.686556233 podStartE2EDuration="2m11.281404919s" podCreationTimestamp="2026-05-25 01:02:48 +0000 UTC" firstStartedPulling="2026-05-25 01:04:57.178338968 +0000 UTC m=+162.968545566" lastFinishedPulling="2026-05-25 01:04:58.773187658 +0000 UTC m=+164.563394252" observedRunningTime="2026-05-25 01:04:59.280306733 +0000 UTC m=+165.070513339" watchObservedRunningTime="2026-05-25 01:04:59.281404919 +0000 UTC m=+165.071611546"
May 25 01:04:59.860006 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.859972    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wj5pj"]
May 25 01:04:59.862992 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.862974    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.865647 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.865627    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9mgnh\""
May 25 01:04:59.865955 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.865937    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 01:04:59.866190 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.866047    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 01:04:59.866190 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.866066    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 01:04:59.866190 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.866071    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 01:04:59.866190 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.866167    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 01:04:59.868557 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.868535    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 01:04:59.969051 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969016    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-textfile\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969051 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969080    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-wtmp\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-metrics-client-ca\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969119    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cm2\" (UniqueName: \"kubernetes.io/projected/da883c0b-ff87-41d2-a746-41871a3953c2-kube-api-access-f8cm2\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-root\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969191    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-sys\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:04:59.969255 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:04:59.969233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.069970 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.069902    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.069970 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.069939    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-wtmp\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.069970 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.069957    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-metrics-client-ca\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.069974    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cm2\" (UniqueName: \"kubernetes.io/projected/da883c0b-ff87-41d2-a746-41871a3953c2-kube-api-access-f8cm2\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070005    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-root\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070053    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-root\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070101    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-wtmp\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070142    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-sys\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070167    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070228 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070197    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070558 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070238    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-textfile\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070558 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070235    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/da883c0b-ff87-41d2-a746-41871a3953c2-sys\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070558 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:05:00.070315    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 01:05:00.070558 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:05:00.070393    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls podName:da883c0b-ff87-41d2-a746-41871a3953c2 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:00.570374 +0000 UTC m=+166.360580589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls") pod "node-exporter-wj5pj" (UID: "da883c0b-ff87-41d2-a746-41871a3953c2") : secret "node-exporter-tls" not found
May 25 01:05:00.070558 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070513    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-textfile\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070819 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-metrics-client-ca\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.070819 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.070666    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.072406 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.072386    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.078753 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.078734    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cm2\" (UniqueName: \"kubernetes.io/projected/da883c0b-ff87-41d2-a746-41871a3953c2-kube-api-access-f8cm2\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.573801 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.573752    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.575995 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.575977    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/da883c0b-ff87-41d2-a746-41871a3953c2-node-exporter-tls\") pod \"node-exporter-wj5pj\" (UID: \"da883c0b-ff87-41d2-a746-41871a3953c2\") " pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.773110 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:00.773081    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj5pj"
May 25 01:05:00.780795 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:05:00.780749    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda883c0b_ff87_41d2_a746_41871a3953c2.slice/crio-8586f2381ca69d529a3a5b477a927a1e560e4449fcdd981d99fbbd5515926a8a WatchSource:0}: Error finding container 8586f2381ca69d529a3a5b477a927a1e560e4449fcdd981d99fbbd5515926a8a: Status 404 returned error can't find the container with id 8586f2381ca69d529a3a5b477a927a1e560e4449fcdd981d99fbbd5515926a8a
May 25 01:05:01.274545 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:01.274500    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj5pj" event={"ID":"da883c0b-ff87-41d2-a746-41871a3953c2","Type":"ContainerStarted","Data":"8586f2381ca69d529a3a5b477a927a1e560e4449fcdd981d99fbbd5515926a8a"}
May 25 01:05:02.277985 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:02.277944    2575 generic.go:358] "Generic (PLEG): container finished" podID="da883c0b-ff87-41d2-a746-41871a3953c2" containerID="dda37c637fa8c0c50eee08a97a8ca5e01dad7bdcfb3e456479127d80c52bb2a2" exitCode=0
May 25 01:05:02.278380 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:02.278000    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj5pj" event={"ID":"da883c0b-ff87-41d2-a746-41871a3953c2","Type":"ContainerDied","Data":"dda37c637fa8c0c50eee08a97a8ca5e01dad7bdcfb3e456479127d80c52bb2a2"}
May 25 01:05:03.283494 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:03.282813    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj5pj" event={"ID":"da883c0b-ff87-41d2-a746-41871a3953c2","Type":"ContainerStarted","Data":"02db6a88e6bb281cfbdc0a4c4650cdf3a8e5b561ef49f25cb2dac944fc8a3c6c"}
May 25 01:05:03.283494 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:03.282856    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj5pj" event={"ID":"da883c0b-ff87-41d2-a746-41871a3953c2","Type":"ContainerStarted","Data":"1d9bca8651ac7a4edeab2403df1af08eecbf7685700a382f12a6edba8387d48f"}
May 25 01:05:03.306244 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:03.306196    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wj5pj" podStartSLOduration=3.408913403 podStartE2EDuration="4.306182299s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:05:00.782438941 +0000 UTC m=+166.572645541" lastFinishedPulling="2026-05-25 01:05:01.679707852 +0000 UTC m=+167.469914437" observedRunningTime="2026-05-25 01:05:03.304365011 +0000 UTC m=+169.094571619" watchObservedRunningTime="2026-05-25 01:05:03.306182299 +0000 UTC m=+169.096388933"
May 25 01:05:03.768197 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:03.768159    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:05:05.767522 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:05.767487    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:05:05.772240 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:05.772213    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:05:05.778303 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:05.778285    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84nsk"
May 25 01:05:05.903510 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:05.903473    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84nsk"]
May 25 01:05:05.907943 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:05:05.907913    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d37131_d722_441a_9bbd_1eab6d47194b.slice/crio-a64d158bb06dc6bcd245337861ef3d63d13d39351ada02b0628b7c7984e2aa15 WatchSource:0}: Error finding container a64d158bb06dc6bcd245337861ef3d63d13d39351ada02b0628b7c7984e2aa15: Status 404 returned error can't find the container with id a64d158bb06dc6bcd245337861ef3d63d13d39351ada02b0628b7c7984e2aa15
May 25 01:05:06.291688 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:06.291637    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84nsk" event={"ID":"b9d37131-d722-441a-9bbd-1eab6d47194b","Type":"ContainerStarted","Data":"a64d158bb06dc6bcd245337861ef3d63d13d39351ada02b0628b7c7984e2aa15"}
May 25 01:05:08.297448 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:08.297411    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84nsk" event={"ID":"b9d37131-d722-441a-9bbd-1eab6d47194b","Type":"ContainerStarted","Data":"55f00e6046862560f737ccc8a386e1198ff45cd58d39863b76342ce09edd7021"}
May 25 01:05:08.313828 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:08.313758    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84nsk" podStartSLOduration=138.84609752 podStartE2EDuration="2m20.313743273s" podCreationTimestamp="2026-05-25 01:02:48 +0000 UTC" firstStartedPulling="2026-05-25 01:05:05.909857913 +0000 UTC m=+171.700064501" lastFinishedPulling="2026-05-25 01:05:07.377503651 +0000 UTC m=+173.167710254" observedRunningTime="2026-05-25 01:05:08.313137154 +0000 UTC m=+174.103343762" watchObservedRunningTime="2026-05-25 01:05:08.313743273 +0000 UTC m=+174.103949910"
May 25 01:05:09.272025 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:09.271997    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w2n7v"
May 25 01:05:14.702708 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:14.702675    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:05:14.706515 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:14.706487    2575 patch_prober.go:28] interesting pod/image-registry-d45565cfd-f78wt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 25 01:05:14.706635 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:14.706540    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 01:05:24.707534 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:24.707493    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:05:34.615012 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:34.614982    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84nsk_b9d37131-d722-441a-9bbd-1eab6d47194b/serve-healthcheck-canary/0.log"
May 25 01:05:38.979288 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:38.979248    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" podUID="67261157-628b-43bb-afd9-b3286a5d6a8f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 01:05:39.721039 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:39.720995    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerName="registry" containerID="cri-o://b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b" gracePeriod=30
May 25 01:05:39.964264 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:39.964243    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:05:40.051256 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051163    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051256 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051214    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051256 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051252    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051274    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051318    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mk4s\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051343    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051374    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.051853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.051411    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca\") pod \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\" (UID: \"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab\") "
May 25 01:05:40.052098 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.052006    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:40.052405 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.052382    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:05:40.054230 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.054175    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:40.054230 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.054212    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:40.054438 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.054414    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:40.054500 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.054434    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:05:40.054533 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.054509    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s" (OuterVolumeSpecName: "kube-api-access-8mk4s") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "kube-api-access-8mk4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:05:40.060597 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.060570    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" (UID: "dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:05:40.152805 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152745    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mk4s\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-kube-api-access-8mk4s\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152805 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152803    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-certificates\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152805 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152813    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-ca-trust-extracted\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152824    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-trusted-ca\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152833    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-bound-sa-token\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152842    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-image-registry-private-configuration\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152851    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-registry-tls\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.152982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.152861    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab-installation-pull-secrets\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:05:40.379589 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.379555    2575 generic.go:358] "Generic (PLEG): container finished" podID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerID="b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b" exitCode=0
May 25 01:05:40.379756 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.379596    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" event={"ID":"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab","Type":"ContainerDied","Data":"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"}
May 25 01:05:40.379756 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.379616    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d45565cfd-f78wt"
May 25 01:05:40.379756 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.379636    2575 scope.go:117] "RemoveContainer" containerID="b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"
May 25 01:05:40.379756 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.379624    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d45565cfd-f78wt" event={"ID":"dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab","Type":"ContainerDied","Data":"3112e9136a3c4935fe33cda558a12b52af3299e9452e7c9c27ebe4625c528a65"}
May 25 01:05:40.388085 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.388066    2575 scope.go:117] "RemoveContainer" containerID="b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"
May 25 01:05:40.388329 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:05:40.388313    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b\": container with ID starting with b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b not found: ID does not exist" containerID="b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"
May 25 01:05:40.388373 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.388337    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b"} err="failed to get container status \"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b\": rpc error: code = NotFound desc = could not find container \"b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b\": container with ID starting with b1270d296152f63dfc9737dce28035b7a4d4eed55cc70b36f592fae8f0d6bd5b not found: ID does not exist"
May 25 01:05:40.399736 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.399713    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:05:40.403152 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.403133    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d45565cfd-f78wt"]
May 25 01:05:40.772128 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:40.772056    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" path="/var/lib/kubelet/pods/dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab/volumes"
May 25 01:05:48.979168 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:48.979128    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" podUID="67261157-628b-43bb-afd9-b3286a5d6a8f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 01:05:58.978983 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:58.978944    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" podUID="67261157-628b-43bb-afd9-b3286a5d6a8f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 25 01:05:58.979330 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:58.979038    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm"
May 25 01:05:58.979465 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:58.979449    2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"de2276a5492a0536b8308630acb9bac0443b2b3356b6cc624732b5f9a7e00322"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 25 01:05:58.979503 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:58.979493    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" podUID="67261157-628b-43bb-afd9-b3286a5d6a8f" containerName="service-proxy" containerID="cri-o://de2276a5492a0536b8308630acb9bac0443b2b3356b6cc624732b5f9a7e00322" gracePeriod=30
May 25 01:05:59.431213 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:59.431182    2575 generic.go:358] "Generic (PLEG): container finished" podID="67261157-628b-43bb-afd9-b3286a5d6a8f" containerID="de2276a5492a0536b8308630acb9bac0443b2b3356b6cc624732b5f9a7e00322" exitCode=2
May 25 01:05:59.431381 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:59.431231    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerDied","Data":"de2276a5492a0536b8308630acb9bac0443b2b3356b6cc624732b5f9a7e00322"}
May 25 01:05:59.431381 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:05:59.431256    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-86d6966d6b-8zbdm" event={"ID":"67261157-628b-43bb-afd9-b3286a5d6a8f","Type":"ContainerStarted","Data":"240ebdc64e07f45de988e13d0d34d9b58e36157bef0a02a46d562521d78eed77"}
May 25 01:06:26.782940 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:26.782909    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:06:26.785098 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:26.785081    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b674d77-e2fe-4a63-a09a-29fa01243f3e-metrics-certs\") pod \"network-metrics-daemon-zghqp\" (UID: \"6b674d77-e2fe-4a63-a09a-29fa01243f3e\") " pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:06:26.871786 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:26.871756    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:06:26.879022 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:26.879005    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zghqp"
May 25 01:06:27.006060 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:27.005931    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zghqp"]
May 25 01:06:27.008447 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:06:27.008419    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b674d77_e2fe_4a63_a09a_29fa01243f3e.slice/crio-a52cf96ab5d81178c7d3ec38160e427969b8bb439dccc5b15aedd58f26b7e55b WatchSource:0}: Error finding container a52cf96ab5d81178c7d3ec38160e427969b8bb439dccc5b15aedd58f26b7e55b: Status 404 returned error can't find the container with id a52cf96ab5d81178c7d3ec38160e427969b8bb439dccc5b15aedd58f26b7e55b
May 25 01:06:27.500302 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:27.500266    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zghqp" event={"ID":"6b674d77-e2fe-4a63-a09a-29fa01243f3e","Type":"ContainerStarted","Data":"a52cf96ab5d81178c7d3ec38160e427969b8bb439dccc5b15aedd58f26b7e55b"}
May 25 01:06:29.506555 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:29.506516    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zghqp" event={"ID":"6b674d77-e2fe-4a63-a09a-29fa01243f3e","Type":"ContainerStarted","Data":"2854fa58d5a5f8adf1c1036e8435a4cebf22d2d6be6956c6785b193890571866"}
May 25 01:06:29.506555 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:29.506553    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zghqp" event={"ID":"6b674d77-e2fe-4a63-a09a-29fa01243f3e","Type":"ContainerStarted","Data":"dbe0f5375e6f1deba85a3c70548f12e9f3de131b369613d767c98609c9f5ad6f"}
May 25 01:06:29.524402 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:06:29.524356    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zghqp" podStartSLOduration=253.080931526 podStartE2EDuration="4m14.524343624s" podCreationTimestamp="2026-05-25 01:02:15 +0000 UTC" firstStartedPulling="2026-05-25 01:06:27.010318056 +0000 UTC m=+252.800524640" lastFinishedPulling="2026-05-25 01:06:28.453730153 +0000 UTC m=+254.243936738" observedRunningTime="2026-05-25 01:06:29.52317737 +0000 UTC m=+255.313383977" watchObservedRunningTime="2026-05-25 01:06:29.524343624 +0000 UTC m=+255.314550265"
May 25 01:07:14.695290 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:07:14.695264    2575 kubelet.go:1628] "Image garbage collection succeeded"
May 25 01:09:28.315232 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.315199    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d5zgw"]
May 25 01:09:28.315629 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.315436    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerName="registry"
May 25 01:09:28.315629 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.315448    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerName="registry"
May 25 01:09:28.315629 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.315498    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="dbeca4ea-9f9a-4bae-815b-906cdd7dc6ab" containerName="registry"
May 25 01:09:28.318139 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.318122    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.320836 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.320817    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jt5qn\""
May 25 01:09:28.321299 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.321284    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 25 01:09:28.321760 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.321746    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 25 01:09:28.327484 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.327464    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d5zgw"]
May 25 01:09:28.421082 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.421046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-bound-sa-token\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.421245 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.421101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9r7\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-kube-api-access-cf9r7\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.522116 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.522084    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9r7\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-kube-api-access-cf9r7\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.522267 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.522148    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-bound-sa-token\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.531443 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.531410    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-bound-sa-token\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.531568 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.531551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9r7\" (UniqueName: \"kubernetes.io/projected/5323d185-a67c-4e86-8856-9ebe89ae7333-kube-api-access-cf9r7\") pod \"cert-manager-79c8d999ff-d5zgw\" (UID: \"5323d185-a67c-4e86-8856-9ebe89ae7333\") " pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.626929 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.626903    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-d5zgw"
May 25 01:09:28.750238 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.750215    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-d5zgw"]
May 25 01:09:28.752563 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:09:28.752541    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5323d185_a67c_4e86_8856_9ebe89ae7333.slice/crio-88379aac1f6e006ec0627c9fab9e4b332434704e076a3f2c3f3d9e947d298d34 WatchSource:0}: Error finding container 88379aac1f6e006ec0627c9fab9e4b332434704e076a3f2c3f3d9e947d298d34: Status 404 returned error can't find the container with id 88379aac1f6e006ec0627c9fab9e4b332434704e076a3f2c3f3d9e947d298d34
May 25 01:09:28.756542 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.756519    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:09:28.939917 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:28.939836    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-d5zgw" event={"ID":"5323d185-a67c-4e86-8856-9ebe89ae7333","Type":"ContainerStarted","Data":"88379aac1f6e006ec0627c9fab9e4b332434704e076a3f2c3f3d9e947d298d34"}
May 25 01:09:29.724060 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.724028    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"]
May 25 01:09:29.727256 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.727230    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.730805 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.730767    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 01:09:29.732363 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.732333    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 01:09:29.732363 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.732338    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tgmmk\""
May 25 01:09:29.737310 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.737268    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"]
May 25 01:09:29.832606 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.832572    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2041cd51-691e-4730-ad1d-14d91e8cb85e-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.832786 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.832620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ld6\" (UniqueName: \"kubernetes.io/projected/2041cd51-691e-4730-ad1d-14d91e8cb85e-kube-api-access-l4ld6\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.933909 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.933872    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2041cd51-691e-4730-ad1d-14d91e8cb85e-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.933909 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.933911    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ld6\" (UniqueName: \"kubernetes.io/projected/2041cd51-691e-4730-ad1d-14d91e8cb85e-kube-api-access-l4ld6\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.934311 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.934291    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2041cd51-691e-4730-ad1d-14d91e8cb85e-tmp\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:29.942982 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:29.942951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ld6\" (UniqueName: \"kubernetes.io/projected/2041cd51-691e-4730-ad1d-14d91e8cb85e-kube-api-access-l4ld6\") pod \"openshift-lws-operator-bfc7f696d-dqtfh\" (UID: \"2041cd51-691e-4730-ad1d-14d91e8cb85e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:30.038540 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:30.038453    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"
May 25 01:09:30.939485 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:30.939396    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh"]
May 25 01:09:30.942288 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:09:30.942257    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2041cd51_691e_4730_ad1d_14d91e8cb85e.slice/crio-86daf3b9ab65027b5aee2df979048f16f1f1b341f95a646c8e9fe40cd3a53231 WatchSource:0}: Error finding container 86daf3b9ab65027b5aee2df979048f16f1f1b341f95a646c8e9fe40cd3a53231: Status 404 returned error can't find the container with id 86daf3b9ab65027b5aee2df979048f16f1f1b341f95a646c8e9fe40cd3a53231
May 25 01:09:30.949248 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:30.949222    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh" event={"ID":"2041cd51-691e-4730-ad1d-14d91e8cb85e","Type":"ContainerStarted","Data":"86daf3b9ab65027b5aee2df979048f16f1f1b341f95a646c8e9fe40cd3a53231"}
May 25 01:09:31.955116 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:31.955059    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-d5zgw" event={"ID":"5323d185-a67c-4e86-8856-9ebe89ae7333","Type":"ContainerStarted","Data":"96395487e7d0266154f6b6c1f59b39fc6b55199922fa5005d68754319201c982"}
May 25 01:09:31.974459 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:31.974391    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-d5zgw" podStartSLOduration=1.854917865 podStartE2EDuration="3.974373115s" podCreationTimestamp="2026-05-25 01:09:28 +0000 UTC" firstStartedPulling="2026-05-25 01:09:28.756699571 +0000 UTC m=+434.546906170" lastFinishedPulling="2026-05-25 01:09:30.876154832 +0000 UTC m=+436.666361420" observedRunningTime="2026-05-25 01:09:31.97165759 +0000 UTC m=+437.761864199" watchObservedRunningTime="2026-05-25 01:09:31.974373115 +0000 UTC m=+437.764579722"
May 25 01:09:33.962259 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:33.962169    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh" event={"ID":"2041cd51-691e-4730-ad1d-14d91e8cb85e","Type":"ContainerStarted","Data":"1b7eda032bc1f4ffd00a855e3af08d411ed002809440717992121dcadc1cda63"}
May 25 01:09:33.980023 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:33.979974    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-dqtfh" podStartSLOduration=2.308654229 podStartE2EDuration="4.979958156s" podCreationTimestamp="2026-05-25 01:09:29 +0000 UTC" firstStartedPulling="2026-05-25 01:09:30.943936666 +0000 UTC m=+436.734143266" lastFinishedPulling="2026-05-25 01:09:33.615240609 +0000 UTC m=+439.405447193" observedRunningTime="2026-05-25 01:09:33.979058322 +0000 UTC m=+439.769264929" watchObservedRunningTime="2026-05-25 01:09:33.979958156 +0000 UTC m=+439.770164764"
May 25 01:09:49.022085 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.022050    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"]
May 25 01:09:49.025168 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.025149    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.029071 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.029051    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-79wbd\""
May 25 01:09:49.029168 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.029056    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 25 01:09:49.029404 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.029386    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 25 01:09:49.029639 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.029624    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 25 01:09:49.029871 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.029852    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 25 01:09:49.066626 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.066599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"]
May 25 01:09:49.069085 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.069063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwv6\" (UniqueName: \"kubernetes.io/projected/7cc1c399-480f-4742-a571-21941d18cb0f-kube-api-access-hfwv6\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.069178 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.069117    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.069178 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.069141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.169674 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.169639    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.169674 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.169680    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.169908 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.169704    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwv6\" (UniqueName: \"kubernetes.io/projected/7cc1c399-480f-4742-a571-21941d18cb0f-kube-api-access-hfwv6\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.172169 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.172140    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.172169 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.172163    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cc1c399-480f-4742-a571-21941d18cb0f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.186884 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.186861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwv6\" (UniqueName: \"kubernetes.io/projected/7cc1c399-480f-4742-a571-21941d18cb0f-kube-api-access-hfwv6\") pod \"opendatahub-operator-controller-manager-6588b9546d-wvwxq\" (UID: \"7cc1c399-480f-4742-a571-21941d18cb0f\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.335269 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.335191    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:49.490932 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:49.490849    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"]
May 25 01:09:49.493863 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:09:49.493831    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc1c399_480f_4742_a571_21941d18cb0f.slice/crio-c100ccec48211472e3354386f9ff13d64be36bdb54a2e315f887e559391a999f WatchSource:0}: Error finding container c100ccec48211472e3354386f9ff13d64be36bdb54a2e315f887e559391a999f: Status 404 returned error can't find the container with id c100ccec48211472e3354386f9ff13d64be36bdb54a2e315f887e559391a999f
May 25 01:09:50.006959 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:50.006925    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq" event={"ID":"7cc1c399-480f-4742-a571-21941d18cb0f","Type":"ContainerStarted","Data":"c100ccec48211472e3354386f9ff13d64be36bdb54a2e315f887e559391a999f"}
May 25 01:09:52.018838 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:52.018802    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq" event={"ID":"7cc1c399-480f-4742-a571-21941d18cb0f","Type":"ContainerStarted","Data":"c02277b087fd3293c84a6d084fcc1cdda8be7929847968f760eabbf02625363b"}
May 25 01:09:52.019211 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:52.018924    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:09:52.045417 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:09:52.045368    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq" podStartSLOduration=1.6784384129999999 podStartE2EDuration="4.045349421s" podCreationTimestamp="2026-05-25 01:09:48 +0000 UTC" firstStartedPulling="2026-05-25 01:09:49.495663074 +0000 UTC m=+455.285869659" lastFinishedPulling="2026-05-25 01:09:51.862574083 +0000 UTC m=+457.652780667" observedRunningTime="2026-05-25 01:09:52.043504139 +0000 UTC m=+457.833710745" watchObservedRunningTime="2026-05-25 01:09:52.045349421 +0000 UTC m=+457.835556029"
May 25 01:10:03.023703 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:03.023669    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-wvwxq"
May 25 01:10:06.925092 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.925053    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"]
May 25 01:10:06.928202 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.928181    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:06.931646 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.931625    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n7ksq\""
May 25 01:10:06.931727 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.931679    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 25 01:10:06.931727 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.931684    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 25 01:10:06.931727 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.931630    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 25 01:10:06.931890 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.931731    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 25 01:10:06.937401 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:06.937356    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"]
May 25 01:10:07.001523 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.001485    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.001523 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.001520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpjk\" (UniqueName: \"kubernetes.io/projected/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-kube-api-access-jdpjk\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.001732 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.001538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tmp\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.102893 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.102855    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.102893 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.102898    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpjk\" (UniqueName: \"kubernetes.io/projected/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-kube-api-access-jdpjk\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.103120 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.102919    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tmp\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.105141 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.105113    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tmp\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.105349 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.105331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.110836 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.110814    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpjk\" (UniqueName: \"kubernetes.io/projected/fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3-kube-api-access-jdpjk\") pod \"kube-auth-proxy-56b48c6bb9-tpd75\" (UID: \"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.237706 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.237608    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"
May 25 01:10:07.361766 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:07.361738    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75"]
May 25 01:10:07.364814 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:10:07.364785    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4eada9_01aa_4bc0_ab9d_4a82aabf7bc3.slice/crio-a1acc30bd48b33622cead55c61aeac3f57bfe6fb3d06f46e9ea5b629149e756a WatchSource:0}: Error finding container a1acc30bd48b33622cead55c61aeac3f57bfe6fb3d06f46e9ea5b629149e756a: Status 404 returned error can't find the container with id a1acc30bd48b33622cead55c61aeac3f57bfe6fb3d06f46e9ea5b629149e756a
May 25 01:10:08.063345 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:08.063283    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75" event={"ID":"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3","Type":"ContainerStarted","Data":"a1acc30bd48b33622cead55c61aeac3f57bfe6fb3d06f46e9ea5b629149e756a"}
May 25 01:10:09.696181 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.696147    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4mwpf"]
May 25 01:10:09.703031 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.702998    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:09.705792 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.705748    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 25 01:10:09.705927 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.705801    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rl4dl\""
May 25 01:10:09.708957 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.708932    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4mwpf"]
May 25 01:10:09.826059 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.825993    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:09.826059 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.826057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h67s\" (UniqueName: \"kubernetes.io/projected/57b5b852-f240-44a9-9c38-d696ff2ec06a-kube-api-access-8h67s\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:09.926789 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.926738    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:09.926988 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.926810    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h67s\" (UniqueName: \"kubernetes.io/projected/57b5b852-f240-44a9-9c38-d696ff2ec06a-kube-api-access-8h67s\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:09.926988 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:09.926934    2575 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 25 01:10:09.927119 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:09.927015    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert podName:57b5b852-f240-44a9-9c38-d696ff2ec06a nodeName:}" failed. No retries permitted until 2026-05-25 01:10:10.426992577 +0000 UTC m=+476.217199179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert") pod "odh-model-controller-858dbf95b8-4mwpf" (UID: "57b5b852-f240-44a9-9c38-d696ff2ec06a") : secret "odh-model-controller-webhook-cert" not found
May 25 01:10:09.938755 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:09.938719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h67s\" (UniqueName: \"kubernetes.io/projected/57b5b852-f240-44a9-9c38-d696ff2ec06a-kube-api-access-8h67s\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:10.431205 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:10.431175    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:10.433708 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:10.433675    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57b5b852-f240-44a9-9c38-d696ff2ec06a-cert\") pod \"odh-model-controller-858dbf95b8-4mwpf\" (UID: \"57b5b852-f240-44a9-9c38-d696ff2ec06a\") " pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:10.616216 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:10.616179    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:10.739817 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:10.739746    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-4mwpf"]
May 25 01:10:10.741868 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:10:10.741845    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b5b852_f240_44a9_9c38_d696ff2ec06a.slice/crio-4fcfcfa99d67cbe277c32249f9234e6d62dabd0b9f548d094c359741969631e5 WatchSource:0}: Error finding container 4fcfcfa99d67cbe277c32249f9234e6d62dabd0b9f548d094c359741969631e5: Status 404 returned error can't find the container with id 4fcfcfa99d67cbe277c32249f9234e6d62dabd0b9f548d094c359741969631e5
May 25 01:10:11.076009 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:11.075925    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75" event={"ID":"fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3","Type":"ContainerStarted","Data":"1f5c7d80d3d2fb6df93b994b9fb9643e181e68961906342e365f4f542b6dfef3"}
May 25 01:10:11.076992 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:11.076964    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" event={"ID":"57b5b852-f240-44a9-9c38-d696ff2ec06a","Type":"ContainerStarted","Data":"4fcfcfa99d67cbe277c32249f9234e6d62dabd0b9f548d094c359741969631e5"}
May 25 01:10:11.094300 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:11.094260    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-tpd75" podStartSLOduration=2.446761111 podStartE2EDuration="5.094246998s" podCreationTimestamp="2026-05-25 01:10:06 +0000 UTC" firstStartedPulling="2026-05-25 01:10:07.366579526 +0000 UTC m=+473.156786110" lastFinishedPulling="2026-05-25 01:10:10.0140654 +0000 UTC m=+475.804271997" observedRunningTime="2026-05-25 01:10:11.092628996 +0000 UTC m=+476.882835604" watchObservedRunningTime="2026-05-25 01:10:11.094246998 +0000 UTC m=+476.884453604"
May 25 01:10:14.087918 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:14.087887    2575 generic.go:358] "Generic (PLEG): container finished" podID="57b5b852-f240-44a9-9c38-d696ff2ec06a" containerID="3add3e05f5728dd87afbe5d8c516e0d8ecad50bc068299db6171afdc6efc765b" exitCode=1
May 25 01:10:14.088301 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:14.087974    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" event={"ID":"57b5b852-f240-44a9-9c38-d696ff2ec06a","Type":"ContainerDied","Data":"3add3e05f5728dd87afbe5d8c516e0d8ecad50bc068299db6171afdc6efc765b"}
May 25 01:10:14.088301 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:14.088158    2575 scope.go:117] "RemoveContainer" containerID="3add3e05f5728dd87afbe5d8c516e0d8ecad50bc068299db6171afdc6efc765b"
May 25 01:10:15.092586 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.092549    2575 generic.go:358] "Generic (PLEG): container finished" podID="57b5b852-f240-44a9-9c38-d696ff2ec06a" containerID="5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3" exitCode=1
May 25 01:10:15.093022 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.092612    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" event={"ID":"57b5b852-f240-44a9-9c38-d696ff2ec06a","Type":"ContainerDied","Data":"5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3"}
May 25 01:10:15.093022 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.092643    2575 scope.go:117] "RemoveContainer" containerID="3add3e05f5728dd87afbe5d8c516e0d8ecad50bc068299db6171afdc6efc765b"
May 25 01:10:15.093022 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.092885    2575 scope.go:117] "RemoveContainer" containerID="5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3"
May 25 01:10:15.093131 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:15.093093    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-4mwpf_opendatahub(57b5b852-f240-44a9-9c38-d696ff2ec06a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" podUID="57b5b852-f240-44a9-9c38-d696ff2ec06a"
May 25 01:10:15.609090 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.609060    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-wjdsp"]
May 25 01:10:15.612148 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.612128    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:15.615386 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.615366    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-w9qjs\""
May 25 01:10:15.615677 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.615662    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 25 01:10:15.670718 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.670680    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-wjdsp"]
May 25 01:10:15.675459 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.675431    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:15.675611 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.675464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9q8\" (UniqueName: \"kubernetes.io/projected/217a2d1a-60ce-498a-9773-a16a1cf602ac-kube-api-access-df9q8\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:15.776100 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.776066    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:15.776257 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.776118    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df9q8\" (UniqueName: \"kubernetes.io/projected/217a2d1a-60ce-498a-9773-a16a1cf602ac-kube-api-access-df9q8\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:15.776257 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:15.776222    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 25 01:10:15.776353 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:15.776285    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert podName:217a2d1a-60ce-498a-9773-a16a1cf602ac nodeName:}" failed. No retries permitted until 2026-05-25 01:10:16.276269227 +0000 UTC m=+482.066475816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert") pod "kserve-controller-manager-856948b99f-wjdsp" (UID: "217a2d1a-60ce-498a-9773-a16a1cf602ac") : secret "kserve-webhook-server-cert" not found
May 25 01:10:15.785259 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:15.785217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9q8\" (UniqueName: \"kubernetes.io/projected/217a2d1a-60ce-498a-9773-a16a1cf602ac-kube-api-access-df9q8\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:16.096951 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:16.096921    2575 scope.go:117] "RemoveContainer" containerID="5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3"
May 25 01:10:16.097307 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:16.097095    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-4mwpf_opendatahub(57b5b852-f240-44a9-9c38-d696ff2ec06a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" podUID="57b5b852-f240-44a9-9c38-d696ff2ec06a"
May 25 01:10:16.279955 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:16.279918    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:16.282249 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:16.282229    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/217a2d1a-60ce-498a-9773-a16a1cf602ac-cert\") pod \"kserve-controller-manager-856948b99f-wjdsp\" (UID: \"217a2d1a-60ce-498a-9773-a16a1cf602ac\") " pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:16.523064 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:16.523020    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:16.641428 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:16.641391    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-wjdsp"]
May 25 01:10:16.645248 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:10:16.645217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217a2d1a_60ce_498a_9773_a16a1cf602ac.slice/crio-0791bf4143ed724e6670b747b58d7cb864df0e2d202549f20f33bf622ed203ee WatchSource:0}: Error finding container 0791bf4143ed724e6670b747b58d7cb864df0e2d202549f20f33bf622ed203ee: Status 404 returned error can't find the container with id 0791bf4143ed724e6670b747b58d7cb864df0e2d202549f20f33bf622ed203ee
May 25 01:10:17.100120 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:17.100087    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp" event={"ID":"217a2d1a-60ce-498a-9773-a16a1cf602ac","Type":"ContainerStarted","Data":"0791bf4143ed724e6670b747b58d7cb864df0e2d202549f20f33bf622ed203ee"}
May 25 01:10:20.109946 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:20.109863    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp" event={"ID":"217a2d1a-60ce-498a-9773-a16a1cf602ac","Type":"ContainerStarted","Data":"3ea48ce4855f7a72e0a625818dee5c241a75441776fba38c9f9de96c684f95c2"}
May 25 01:10:20.110327 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:20.109983    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:10:20.138848 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:20.138794    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp" podStartSLOduration=1.958700652 podStartE2EDuration="5.138760207s" podCreationTimestamp="2026-05-25 01:10:15 +0000 UTC" firstStartedPulling="2026-05-25 01:10:16.646640501 +0000 UTC m=+482.436847086" lastFinishedPulling="2026-05-25 01:10:19.826700052 +0000 UTC m=+485.616906641" observedRunningTime="2026-05-25 01:10:20.137623604 +0000 UTC m=+485.927830208" watchObservedRunningTime="2026-05-25 01:10:20.138760207 +0000 UTC m=+485.928966814"
May 25 01:10:20.616820 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:20.616792    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:20.617151 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:20.617139    2575 scope.go:117] "RemoveContainer" containerID="5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3"
May 25 01:10:20.617307 ip-10-0-142-62 kubenswrapper[2575]: E0525 01:10:20.617292    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-4mwpf_opendatahub(57b5b852-f240-44a9-9c38-d696ff2ec06a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" podUID="57b5b852-f240-44a9-9c38-d696ff2ec06a"
May 25 01:10:21.176893 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.176865    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"]
May 25 01:10:21.179974 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.179957    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.182916 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.182900    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 25 01:10:21.182916 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.182907    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-96b7r\""
May 25 01:10:21.183065 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.183026    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 25 01:10:21.192619 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.192597    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"]
May 25 01:10:21.315408 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.315378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/458ff30b-f655-4385-a68b-d113a7f425ec-operator-config\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.315572 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.315460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkx2b\" (UniqueName: \"kubernetes.io/projected/458ff30b-f655-4385-a68b-d113a7f425ec-kube-api-access-fkx2b\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.416062 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.416031    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkx2b\" (UniqueName: \"kubernetes.io/projected/458ff30b-f655-4385-a68b-d113a7f425ec-kube-api-access-fkx2b\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.416225 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.416070    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/458ff30b-f655-4385-a68b-d113a7f425ec-operator-config\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.418522 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.418492    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/458ff30b-f655-4385-a68b-d113a7f425ec-operator-config\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.441289 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.441230    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkx2b\" (UniqueName: \"kubernetes.io/projected/458ff30b-f655-4385-a68b-d113a7f425ec-kube-api-access-fkx2b\") pod \"servicemesh-operator3-55f49c5f94-m4kqs\" (UID: \"458ff30b-f655-4385-a68b-d113a7f425ec\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.489213 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.489184    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:21.616176 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:21.616151    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"]
May 25 01:10:21.618440 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:10:21.618416    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458ff30b_f655_4385_a68b_d113a7f425ec.slice/crio-a5ae11247453b496b7306f03994a98170d5c89c93414eb887439126feee3418c WatchSource:0}: Error finding container a5ae11247453b496b7306f03994a98170d5c89c93414eb887439126feee3418c: Status 404 returned error can't find the container with id a5ae11247453b496b7306f03994a98170d5c89c93414eb887439126feee3418c
May 25 01:10:22.117103 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:22.117068    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs" event={"ID":"458ff30b-f655-4385-a68b-d113a7f425ec","Type":"ContainerStarted","Data":"a5ae11247453b496b7306f03994a98170d5c89c93414eb887439126feee3418c"}
May 25 01:10:26.132353 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:26.132313    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs" event={"ID":"458ff30b-f655-4385-a68b-d113a7f425ec","Type":"ContainerStarted","Data":"0810f0a53acb216a204a9f7bfaaaf206146063634c742c2399ed4599e2d98e72"}
May 25 01:10:26.132750 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:26.132427    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:26.153074 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:26.153020    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs" podStartSLOduration=1.415413528 podStartE2EDuration="5.153004933s" podCreationTimestamp="2026-05-25 01:10:21 +0000 UTC" firstStartedPulling="2026-05-25 01:10:21.62079205 +0000 UTC m=+487.410998635" lastFinishedPulling="2026-05-25 01:10:25.358383455 +0000 UTC m=+491.148590040" observedRunningTime="2026-05-25 01:10:26.150281816 +0000 UTC m=+491.940488424" watchObservedRunningTime="2026-05-25 01:10:26.153004933 +0000 UTC m=+491.943211541"
May 25 01:10:28.908466 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.908424    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"]
May 25 01:10:28.910422 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.910403    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:28.913166 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.913144    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 25 01:10:28.913336 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.913181    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 25 01:10:28.913336 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.913179    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 25 01:10:28.913503 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.913227    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7wq6j\""
May 25 01:10:28.913503 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.913228    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 25 01:10:28.921093 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:28.921070    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"]
May 25 01:10:29.072710 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.072903 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.072903 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072767    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.072903 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.072903 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.073057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2p4q\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-kube-api-access-c2p4q\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.073057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.072948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd6637b-d805-4297-9b72-7262ace63af8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173507    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173544    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173569    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173595 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173588    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173622    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2p4q\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-kube-api-access-c2p4q\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173648    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd6637b-d805-4297-9b72-7262ace63af8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.173928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.173698    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.174207 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.174180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.175950 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.175919    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd6637b-d805-4297-9b72-7262ace63af8-local-certs\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.176129 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.176104    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-cacerts\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.176365 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.176341    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.176512 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.176493    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd6637b-d805-4297-9b72-7262ace63af8-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.186909 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.186885    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-istio-token\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.187263 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.187244    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2p4q\" (UniqueName: \"kubernetes.io/projected/efd6637b-d805-4297-9b72-7262ace63af8-kube-api-access-c2p4q\") pod \"istiod-openshift-gateway-798958bb55-sqdkv\" (UID: \"efd6637b-d805-4297-9b72-7262ace63af8\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.219725 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.219701    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:29.348610 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:29.348579    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"]
May 25 01:10:29.351412 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:10:29.351380    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd6637b_d805_4297_9b72_7262ace63af8.slice/crio-5c5c086d5f1ed4bf88687886c0fdca4d84805f8a22509bfdac630609d23f428c WatchSource:0}: Error finding container 5c5c086d5f1ed4bf88687886c0fdca4d84805f8a22509bfdac630609d23f428c: Status 404 returned error can't find the container with id 5c5c086d5f1ed4bf88687886c0fdca4d84805f8a22509bfdac630609d23f428c
May 25 01:10:30.146691 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:30.146655    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv" event={"ID":"efd6637b-d805-4297-9b72-7262ace63af8","Type":"ContainerStarted","Data":"5c5c086d5f1ed4bf88687886c0fdca4d84805f8a22509bfdac630609d23f428c"}
May 25 01:10:30.617488 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:30.617133    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:30.617984 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:30.617962    2575 scope.go:117] "RemoveContainer" containerID="5ae3497f84e709a7cd7d9e377c1aebad6349ceaa91fff8e0830b8de8e1dac0c3"
May 25 01:10:31.153341 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:31.153211    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" event={"ID":"57b5b852-f240-44a9-9c38-d696ff2ec06a","Type":"ContainerStarted","Data":"3162e5f588997595ec1ad9d3cf4e53aa4225ab19b24f5414fb54427a11c71817"}
May 25 01:10:31.153341 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:31.153332    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:31.178296 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:31.178246    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf" podStartSLOduration=2.049575378 podStartE2EDuration="22.178230482s" podCreationTimestamp="2026-05-25 01:10:09 +0000 UTC" firstStartedPulling="2026-05-25 01:10:10.743505847 +0000 UTC m=+476.533712443" lastFinishedPulling="2026-05-25 01:10:30.872160958 +0000 UTC m=+496.662367547" observedRunningTime="2026-05-25 01:10:31.177923325 +0000 UTC m=+496.968129932" watchObservedRunningTime="2026-05-25 01:10:31.178230482 +0000 UTC m=+496.968437089"
May 25 01:10:32.515175 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:32.515138    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 01:10:32.515406 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:32.515207    2575 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 01:10:33.162252 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:33.162216    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv" event={"ID":"efd6637b-d805-4297-9b72-7262ace63af8","Type":"ContainerStarted","Data":"f83087ee093789d5708b81d90131a238f7ef746b1828d21291f821774a5931f5"}
May 25 01:10:33.162474 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:33.162452    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:33.164288 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:33.164246    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-sqdkv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 25 01:10:33.164407 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:33.164316    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv" podUID="efd6637b-d805-4297-9b72-7262ace63af8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 01:10:34.168463 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:34.168433    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv"
May 25 01:10:34.189299 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:34.189254    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-sqdkv" podStartSLOduration=3.027622159 podStartE2EDuration="6.189241396s" podCreationTimestamp="2026-05-25 01:10:28 +0000 UTC" firstStartedPulling="2026-05-25 01:10:29.353300027 +0000 UTC m=+495.143506611" lastFinishedPulling="2026-05-25 01:10:32.514919248 +0000 UTC m=+498.305125848" observedRunningTime="2026-05-25 01:10:33.184612315 +0000 UTC m=+498.974818923" watchObservedRunningTime="2026-05-25 01:10:34.189241396 +0000 UTC m=+499.979448000"
May 25 01:10:37.136930 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:37.136901    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-m4kqs"
May 25 01:10:42.160179 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:42.160151    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-4mwpf"
May 25 01:10:51.116790 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:10:51.116752    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-wjdsp"
May 25 01:11:41.336928 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.336886    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"]
May 25 01:11:41.339915 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.339894    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:41.342238 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.342214    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 01:11:41.342238 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.342231    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 25 01:11:41.343251 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.343234    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vrb9w\""
May 25 01:11:41.343323 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.343234    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 01:11:41.350533 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.350509    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"]
May 25 01:11:41.435188 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.435141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgv4\" (UniqueName: \"kubernetes.io/projected/b009302c-d928-4180-8c53-039fad93a9ff-kube-api-access-djgv4\") pod \"dns-operator-controller-manager-648d5c98bc-ml7jp\" (UID: \"b009302c-d928-4180-8c53-039fad93a9ff\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:41.536260 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.536222    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djgv4\" (UniqueName: \"kubernetes.io/projected/b009302c-d928-4180-8c53-039fad93a9ff-kube-api-access-djgv4\") pod \"dns-operator-controller-manager-648d5c98bc-ml7jp\" (UID: \"b009302c-d928-4180-8c53-039fad93a9ff\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:41.548085 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.548054    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgv4\" (UniqueName: \"kubernetes.io/projected/b009302c-d928-4180-8c53-039fad93a9ff-kube-api-access-djgv4\") pod \"dns-operator-controller-manager-648d5c98bc-ml7jp\" (UID: \"b009302c-d928-4180-8c53-039fad93a9ff\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:41.650225 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.650190    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:41.776421 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:41.776398    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"]
May 25 01:11:41.779597 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:11:41.779570    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb009302c_d928_4180_8c53_039fad93a9ff.slice/crio-61bfd669260e0937651670059beacd3801d5c6f463a7f4566fdabddb8ef0836b WatchSource:0}: Error finding container 61bfd669260e0937651670059beacd3801d5c6f463a7f4566fdabddb8ef0836b: Status 404 returned error can't find the container with id 61bfd669260e0937651670059beacd3801d5c6f463a7f4566fdabddb8ef0836b
May 25 01:11:42.372317 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:42.372280    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp" event={"ID":"b009302c-d928-4180-8c53-039fad93a9ff","Type":"ContainerStarted","Data":"61bfd669260e0937651670059beacd3801d5c6f463a7f4566fdabddb8ef0836b"}
May 25 01:11:44.379247 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:44.379209    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp" event={"ID":"b009302c-d928-4180-8c53-039fad93a9ff","Type":"ContainerStarted","Data":"526d8abe9cf2816f931149ae098e21b6aa55ee0a6dbfd8a97cf9f07f280f5125"}
May 25 01:11:44.379627 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:44.379337    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:44.398062 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:44.398020    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp" podStartSLOduration=0.969988702 podStartE2EDuration="3.398004009s" podCreationTimestamp="2026-05-25 01:11:41 +0000 UTC" firstStartedPulling="2026-05-25 01:11:41.781966828 +0000 UTC m=+567.572173414" lastFinishedPulling="2026-05-25 01:11:44.209982136 +0000 UTC m=+570.000188721" observedRunningTime="2026-05-25 01:11:44.39675997 +0000 UTC m=+570.186966579" watchObservedRunningTime="2026-05-25 01:11:44.398004009 +0000 UTC m=+570.188210618"
May 25 01:11:45.025627 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.025586    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn7c4"]
May 25 01:11:45.028934 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.028912    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:45.031573 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.031549    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mf6hj\""
May 25 01:11:45.039529 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.039507    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn7c4"]
May 25 01:11:45.165069 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.165036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2sl\" (UniqueName: \"kubernetes.io/projected/f8a46147-2a32-4464-9f8b-251587cbffb2-kube-api-access-mn2sl\") pod \"authorino-operator-657f44b778-dn7c4\" (UID: \"f8a46147-2a32-4464-9f8b-251587cbffb2\") " pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:45.265837 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.265768    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2sl\" (UniqueName: \"kubernetes.io/projected/f8a46147-2a32-4464-9f8b-251587cbffb2-kube-api-access-mn2sl\") pod \"authorino-operator-657f44b778-dn7c4\" (UID: \"f8a46147-2a32-4464-9f8b-251587cbffb2\") " pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:45.274120 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.274095    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2sl\" (UniqueName: \"kubernetes.io/projected/f8a46147-2a32-4464-9f8b-251587cbffb2-kube-api-access-mn2sl\") pod \"authorino-operator-657f44b778-dn7c4\" (UID: \"f8a46147-2a32-4464-9f8b-251587cbffb2\") " pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:45.339000 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.338920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:45.459933 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:45.459795    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-dn7c4"]
May 25 01:11:45.462594 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:11:45.462569    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a46147_2a32_4464_9f8b_251587cbffb2.slice/crio-73f04258654a3df7d993ba1bc7cf7dbbf9bdc1f5254b87b87845df9dc10992e0 WatchSource:0}: Error finding container 73f04258654a3df7d993ba1bc7cf7dbbf9bdc1f5254b87b87845df9dc10992e0: Status 404 returned error can't find the container with id 73f04258654a3df7d993ba1bc7cf7dbbf9bdc1f5254b87b87845df9dc10992e0
May 25 01:11:46.388078 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:46.388044    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4" event={"ID":"f8a46147-2a32-4464-9f8b-251587cbffb2","Type":"ContainerStarted","Data":"73f04258654a3df7d993ba1bc7cf7dbbf9bdc1f5254b87b87845df9dc10992e0"}
May 25 01:11:48.395116 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:48.395085    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4" event={"ID":"f8a46147-2a32-4464-9f8b-251587cbffb2","Type":"ContainerStarted","Data":"184cff7c3c7950237f81dd323b036696d7f7d5b0bd8ee63bc577d1afc9276e61"}
May 25 01:11:48.395500 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:48.395176    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:11:48.414925 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:48.414870    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4" podStartSLOduration=1.017578034 podStartE2EDuration="3.41485672s" podCreationTimestamp="2026-05-25 01:11:45 +0000 UTC" firstStartedPulling="2026-05-25 01:11:45.46473539 +0000 UTC m=+571.254941975" lastFinishedPulling="2026-05-25 01:11:47.862014071 +0000 UTC m=+573.652220661" observedRunningTime="2026-05-25 01:11:48.413897841 +0000 UTC m=+574.204104452" watchObservedRunningTime="2026-05-25 01:11:48.41485672 +0000 UTC m=+574.205063324"
May 25 01:11:55.385910 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:55.385879    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-ml7jp"
May 25 01:11:59.400163 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:11:59.400134    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-dn7c4"
May 25 01:12:08.783847 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.783812    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"]
May 25 01:12:08.786687 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.786671    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:08.789488 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.789466    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vwfcn\""
May 25 01:12:08.797633 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.797607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"]
May 25 01:12:08.839185 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.839155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkfsc\" (UniqueName: \"kubernetes.io/projected/c8b5a199-f7ef-4e65-887a-276bdabbc9f6-kube-api-access-lkfsc\") pod \"limitador-operator-controller-manager-85c4996f8c-xmbl9\" (UID: \"c8b5a199-f7ef-4e65-887a-276bdabbc9f6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:08.940461 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.940427    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lkfsc\" (UniqueName: \"kubernetes.io/projected/c8b5a199-f7ef-4e65-887a-276bdabbc9f6-kube-api-access-lkfsc\") pod \"limitador-operator-controller-manager-85c4996f8c-xmbl9\" (UID: \"c8b5a199-f7ef-4e65-887a-276bdabbc9f6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:08.949781 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:08.949752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkfsc\" (UniqueName: \"kubernetes.io/projected/c8b5a199-f7ef-4e65-887a-276bdabbc9f6-kube-api-access-lkfsc\") pod \"limitador-operator-controller-manager-85c4996f8c-xmbl9\" (UID: \"c8b5a199-f7ef-4e65-887a-276bdabbc9f6\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:09.097927 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:09.097827    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:09.239017 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:09.238986    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"]
May 25 01:12:09.242142 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:12:09.242114    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b5a199_f7ef_4e65_887a_276bdabbc9f6.slice/crio-c21baacc353f20bb703fdca5a6d476c9a6e92f4664f1726c10c32575c3adf139 WatchSource:0}: Error finding container c21baacc353f20bb703fdca5a6d476c9a6e92f4664f1726c10c32575c3adf139: Status 404 returned error can't find the container with id c21baacc353f20bb703fdca5a6d476c9a6e92f4664f1726c10c32575c3adf139
May 25 01:12:09.466485 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:09.466450    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9" event={"ID":"c8b5a199-f7ef-4e65-887a-276bdabbc9f6","Type":"ContainerStarted","Data":"c21baacc353f20bb703fdca5a6d476c9a6e92f4664f1726c10c32575c3adf139"}
May 25 01:12:11.476940 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:11.476907    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9" event={"ID":"c8b5a199-f7ef-4e65-887a-276bdabbc9f6","Type":"ContainerStarted","Data":"0ecdf34689158eb2d1f9a3df0a090d9b55224eaf35d0696ff047c15318a87a32"}
May 25 01:12:11.477313 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:11.476958    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:12:11.495669 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:11.495623    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9" podStartSLOduration=1.874767356 podStartE2EDuration="3.495609199s" podCreationTimestamp="2026-05-25 01:12:08 +0000 UTC" firstStartedPulling="2026-05-25 01:12:09.244067565 +0000 UTC m=+595.034274150" lastFinishedPulling="2026-05-25 01:12:10.864909405 +0000 UTC m=+596.655115993" observedRunningTime="2026-05-25 01:12:11.493821513 +0000 UTC m=+597.284028164" watchObservedRunningTime="2026-05-25 01:12:11.495609199 +0000 UTC m=+597.285815805"
May 25 01:12:22.483257 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:12:22.483227    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xmbl9"
May 25 01:13:29.518633 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.518598    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:29.521704 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.521646    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:29.524312 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.524286    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 25 01:13:29.524860 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.524841    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-chf7f\""
May 25 01:13:29.533493 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.533470    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:29.582115 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.582086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmm5\" (UniqueName: \"kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5\") pod \"maas-controller-78f84c97c8-fsfr2\" (UID: \"c302256d-65ab-4129-8600-ab736310aa53\") " pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:29.682614 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.682585    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmm5\" (UniqueName: \"kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5\") pod \"maas-controller-78f84c97c8-fsfr2\" (UID: \"c302256d-65ab-4129-8600-ab736310aa53\") " pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:29.693375 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.693348    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmm5\" (UniqueName: \"kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5\") pod \"maas-controller-78f84c97c8-fsfr2\" (UID: \"c302256d-65ab-4129-8600-ab736310aa53\") " pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:29.833905 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.833829    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:29.955140 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:29.955119    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:29.957530 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:13:29.957505    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc302256d_65ab_4129_8600_ab736310aa53.slice/crio-4c7a3b738872d847cf35caee806467c457eaa4a987f147deeb2622f250575e54 WatchSource:0}: Error finding container 4c7a3b738872d847cf35caee806467c457eaa4a987f147deeb2622f250575e54: Status 404 returned error can't find the container with id 4c7a3b738872d847cf35caee806467c457eaa4a987f147deeb2622f250575e54
May 25 01:13:30.738201 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:30.738158    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" event={"ID":"c302256d-65ab-4129-8600-ab736310aa53","Type":"ContainerStarted","Data":"4c7a3b738872d847cf35caee806467c457eaa4a987f147deeb2622f250575e54"}
May 25 01:13:32.746000 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:32.745961    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" event={"ID":"c302256d-65ab-4129-8600-ab736310aa53","Type":"ContainerStarted","Data":"84289422ccef50937f74151de0c0c1560494d34015d9e751d6ad383d8f879a20"}
May 25 01:13:32.746421 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:32.746085    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:32.763032 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:32.762982    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" podStartSLOduration=1.484763759 podStartE2EDuration="3.762968377s" podCreationTimestamp="2026-05-25 01:13:29 +0000 UTC" firstStartedPulling="2026-05-25 01:13:29.958941032 +0000 UTC m=+675.749147637" lastFinishedPulling="2026-05-25 01:13:32.237145667 +0000 UTC m=+678.027352255" observedRunningTime="2026-05-25 01:13:32.7627953 +0000 UTC m=+678.553001908" watchObservedRunningTime="2026-05-25 01:13:32.762968377 +0000 UTC m=+678.553174993"
May 25 01:13:43.754652 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:43.754621    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:44.643519 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:44.643486    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:44.643706 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:44.643685    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" podUID="c302256d-65ab-4129-8600-ab736310aa53" containerName="manager" containerID="cri-o://84289422ccef50937f74151de0c0c1560494d34015d9e751d6ad383d8f879a20" gracePeriod=30
May 25 01:13:44.783798 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:44.783744    2575 generic.go:358] "Generic (PLEG): container finished" podID="c302256d-65ab-4129-8600-ab736310aa53" containerID="84289422ccef50937f74151de0c0c1560494d34015d9e751d6ad383d8f879a20" exitCode=0
May 25 01:13:44.784232 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:44.783810    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" event={"ID":"c302256d-65ab-4129-8600-ab736310aa53","Type":"ContainerDied","Data":"84289422ccef50937f74151de0c0c1560494d34015d9e751d6ad383d8f879a20"}
May 25 01:13:44.886849 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:44.886827    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:45.016969 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.016879    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrmm5\" (UniqueName: \"kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5\") pod \"c302256d-65ab-4129-8600-ab736310aa53\" (UID: \"c302256d-65ab-4129-8600-ab736310aa53\") "
May 25 01:13:45.019003 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.018969    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5" (OuterVolumeSpecName: "kube-api-access-nrmm5") pod "c302256d-65ab-4129-8600-ab736310aa53" (UID: "c302256d-65ab-4129-8600-ab736310aa53"). InnerVolumeSpecName "kube-api-access-nrmm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:13:45.117483 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.117450    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrmm5\" (UniqueName: \"kubernetes.io/projected/c302256d-65ab-4129-8600-ab736310aa53-kube-api-access-nrmm5\") on node \"ip-10-0-142-62.ec2.internal\" DevicePath \"\""
May 25 01:13:45.788607 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.788570    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f84c97c8-fsfr2" event={"ID":"c302256d-65ab-4129-8600-ab736310aa53","Type":"ContainerDied","Data":"4c7a3b738872d847cf35caee806467c457eaa4a987f147deeb2622f250575e54"}
May 25 01:13:45.788607 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.788605    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f84c97c8-fsfr2"
May 25 01:13:45.789106 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.788612    2575 scope.go:117] "RemoveContainer" containerID="84289422ccef50937f74151de0c0c1560494d34015d9e751d6ad383d8f879a20"
May 25 01:13:45.812952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.812904    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:45.813428 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:45.813409    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78f84c97c8-fsfr2"]
May 25 01:13:46.772418 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:13:46.772385    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c302256d-65ab-4129-8600-ab736310aa53" path="/var/lib/kubelet/pods/c302256d-65ab-4129-8600-ab736310aa53/volumes"
May 25 01:14:30.194737 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.194698    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"]
May 25 01:14:30.195159 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.195016    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c302256d-65ab-4129-8600-ab736310aa53" containerName="manager"
May 25 01:14:30.195159 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.195027    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c302256d-65ab-4129-8600-ab736310aa53" containerName="manager"
May 25 01:14:30.195159 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.195074    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c302256d-65ab-4129-8600-ab736310aa53" containerName="manager"
May 25 01:14:30.199622 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.199602    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.202098 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.202075    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 25 01:14:30.202263 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.202247    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 25 01:14:30.202316 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.202275    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 25 01:14:30.203227 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.203212    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2lx8d\""
May 25 01:14:30.208952 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.208927    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"]
May 25 01:14:30.250273 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f55370-cf2a-4806-8c3a-94b0d21f6728-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.250437 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250283    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.250437 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.250545 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.250545 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.250545 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.250530    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njnl8\" (UniqueName: \"kubernetes.io/projected/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kube-api-access-njnl8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.351794 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.351743    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.351966 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.351842    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.351966 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.351907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.351966 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.351956    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.352182 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.352077    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njnl8\" (UniqueName: \"kubernetes.io/projected/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kube-api-access-njnl8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.352229 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.352219    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f55370-cf2a-4806-8c3a-94b0d21f6728-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.352276 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.352162    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.352379 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.352359    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.352527 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.352508    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.354617 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.354589    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6f55370-cf2a-4806-8c3a-94b0d21f6728-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.354963 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.354945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6f55370-cf2a-4806-8c3a-94b0d21f6728-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.360795 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.360753    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njnl8\" (UniqueName: \"kubernetes.io/projected/f6f55370-cf2a-4806-8c3a-94b0d21f6728-kube-api-access-njnl8\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-jr5gb\" (UID: \"f6f55370-cf2a-4806-8c3a-94b0d21f6728\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.516560 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.516481    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:30.640019 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.639990    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"]
May 25 01:14:30.642516 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:14:30.642449    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f55370_cf2a_4806_8c3a_94b0d21f6728.slice/crio-c3bcdc7aaa5845255e3bbc51bf60c877645248787cb545ef58b17b104067ff16 WatchSource:0}: Error finding container c3bcdc7aaa5845255e3bbc51bf60c877645248787cb545ef58b17b104067ff16: Status 404 returned error can't find the container with id c3bcdc7aaa5845255e3bbc51bf60c877645248787cb545ef58b17b104067ff16
May 25 01:14:30.649321 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.649290    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:14:30.929764 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:30.929732    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb" event={"ID":"f6f55370-cf2a-4806-8c3a-94b0d21f6728","Type":"ContainerStarted","Data":"c3bcdc7aaa5845255e3bbc51bf60c877645248787cb545ef58b17b104067ff16"}
May 25 01:14:37.960050 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:37.960014    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb" event={"ID":"f6f55370-cf2a-4806-8c3a-94b0d21f6728","Type":"ContainerStarted","Data":"84ac863ce583678a9f7a7fc99e8bcc38699422c8c5c82a2435020a0c76da77a9"}
May 25 01:14:42.977176 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:42.977138    2575 generic.go:358] "Generic (PLEG): container finished" podID="f6f55370-cf2a-4806-8c3a-94b0d21f6728" containerID="84ac863ce583678a9f7a7fc99e8bcc38699422c8c5c82a2435020a0c76da77a9" exitCode=0
May 25 01:14:42.977559 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:42.977205    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb" event={"ID":"f6f55370-cf2a-4806-8c3a-94b0d21f6728","Type":"ContainerDied","Data":"84ac863ce583678a9f7a7fc99e8bcc38699422c8c5c82a2435020a0c76da77a9"}
May 25 01:14:44.985637 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:44.985597    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb" event={"ID":"f6f55370-cf2a-4806-8c3a-94b0d21f6728","Type":"ContainerStarted","Data":"7039d20b04af73ff65e679f2bb7d10c2e6f6ac087cf24c9bfbade04e6f738ea2"}
May 25 01:14:44.986041 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:44.985816    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:45.002285 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:45.002235    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb" podStartSLOduration=1.531430868 podStartE2EDuration="15.002218951s" podCreationTimestamp="2026-05-25 01:14:30 +0000 UTC" firstStartedPulling="2026-05-25 01:14:30.649468115 +0000 UTC m=+736.439674702" lastFinishedPulling="2026-05-25 01:14:44.120256197 +0000 UTC m=+749.910462785" observedRunningTime="2026-05-25 01:14:45.001878874 +0000 UTC m=+750.792085482" watchObservedRunningTime="2026-05-25 01:14:45.002218951 +0000 UTC m=+750.792425557"
May 25 01:14:47.885371 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:47.885337    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"]
May 25 01:14:47.889680 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:47.889660    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:47.892112 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:47.892087    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 25 01:14:47.898042 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:47.898014    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"]
May 25 01:14:48.005999 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.005972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvhg\" (UniqueName: \"kubernetes.io/projected/49de1bbd-0111-489a-bf0e-b526774936c0-kube-api-access-7xvhg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.006160 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.006008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.006160 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.006047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.006160 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.006068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.006160 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.006113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.006297 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.006166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49de1bbd-0111-489a-bf0e-b526774936c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.106968 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.106935    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvhg\" (UniqueName: \"kubernetes.io/projected/49de1bbd-0111-489a-bf0e-b526774936c0-kube-api-access-7xvhg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107193 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.106977    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107193 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107017    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107306 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107188    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107306 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107238    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107306 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107284    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49de1bbd-0111-489a-bf0e-b526774936c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107459 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107420    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107532 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.107664 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.107586    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.109281 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.109258    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49de1bbd-0111-489a-bf0e-b526774936c0-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.109603 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.109585    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49de1bbd-0111-489a-bf0e-b526774936c0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.114360 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.114333    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvhg\" (UniqueName: \"kubernetes.io/projected/49de1bbd-0111-489a-bf0e-b526774936c0-kube-api-access-7xvhg\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x\" (UID: \"49de1bbd-0111-489a-bf0e-b526774936c0\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.199416 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.199311    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:14:48.328801 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.328758    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"]
May 25 01:14:48.331428 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:14:48.331399    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49de1bbd_0111_489a_bf0e_b526774936c0.slice/crio-4aa17660bbdd303a08f703ef01e6a5ee3d7a32f2bf4f7afaa1dddd77dc8c7fb3 WatchSource:0}: Error finding container 4aa17660bbdd303a08f703ef01e6a5ee3d7a32f2bf4f7afaa1dddd77dc8c7fb3: Status 404 returned error can't find the container with id 4aa17660bbdd303a08f703ef01e6a5ee3d7a32f2bf4f7afaa1dddd77dc8c7fb3
May 25 01:14:48.999531 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.999493    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x" event={"ID":"49de1bbd-0111-489a-bf0e-b526774936c0","Type":"ContainerStarted","Data":"92f176d37b5d0ea35d74487a64837afb07187b95212c2fb15bb7fd96c1200143"}
May 25 01:14:48.999934 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:48.999540    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x" event={"ID":"49de1bbd-0111-489a-bf0e-b526774936c0","Type":"ContainerStarted","Data":"4aa17660bbdd303a08f703ef01e6a5ee3d7a32f2bf4f7afaa1dddd77dc8c7fb3"}
May 25 01:14:55.284975 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.284942    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"]
May 25 01:14:55.292151 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.292123    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.294688 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.294653    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 25 01:14:55.295462 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.295439    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"]
May 25 01:14:55.376222 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376186    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn97p\" (UniqueName: \"kubernetes.io/projected/906550ac-2a00-48c2-870c-61df6a4d92a4-kube-api-access-gn97p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.376222 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376256    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906550ac-2a00-48c2-870c-61df6a4d92a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.376222 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.376605 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.376605 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376341    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.376605 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.376395    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.477877 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.477839    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn97p\" (UniqueName: \"kubernetes.io/projected/906550ac-2a00-48c2-870c-61df6a4d92a4-kube-api-access-gn97p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.477915    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906550ac-2a00-48c2-870c-61df6a4d92a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.477951    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.477970    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.478007    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478057 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.478028    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478501 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.478477    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478590 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.478502    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.478590 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.478547    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.480247 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.480225    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/906550ac-2a00-48c2-870c-61df6a4d92a4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.480428 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.480411    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/906550ac-2a00-48c2-870c-61df6a4d92a4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.485397 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.485373    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn97p\" (UniqueName: \"kubernetes.io/projected/906550ac-2a00-48c2-870c-61df6a4d92a4-kube-api-access-gn97p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt\" (UID: \"906550ac-2a00-48c2-870c-61df6a4d92a4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.603496 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.603422    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:14:55.730711 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:55.730688    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"]
May 25 01:14:55.732958 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:14:55.732934    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906550ac_2a00_48c2_870c_61df6a4d92a4.slice/crio-52bc58272e588461c243aac335363b59521b7c40e62e7a45125c98de7f349a33 WatchSource:0}: Error finding container 52bc58272e588461c243aac335363b59521b7c40e62e7a45125c98de7f349a33: Status 404 returned error can't find the container with id 52bc58272e588461c243aac335363b59521b7c40e62e7a45125c98de7f349a33
May 25 01:14:56.004122 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:56.004091    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-jr5gb"
May 25 01:14:56.026117 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:56.026071    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt" event={"ID":"906550ac-2a00-48c2-870c-61df6a4d92a4","Type":"ContainerStarted","Data":"2f1df76542df0f9de82b1a201b8b688b36e5410a02212c29cbd592ca48684e16"}
May 25 01:14:56.026117 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:56.026123    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt" event={"ID":"906550ac-2a00-48c2-870c-61df6a4d92a4","Type":"ContainerStarted","Data":"52bc58272e588461c243aac335363b59521b7c40e62e7a45125c98de7f349a33"}
May 25 01:14:57.030426 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:57.030398    2575 generic.go:358] "Generic (PLEG): container finished" podID="49de1bbd-0111-489a-bf0e-b526774936c0" containerID="92f176d37b5d0ea35d74487a64837afb07187b95212c2fb15bb7fd96c1200143" exitCode=0
May 25 01:14:57.030853 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:57.030477    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x" event={"ID":"49de1bbd-0111-489a-bf0e-b526774936c0","Type":"ContainerDied","Data":"92f176d37b5d0ea35d74487a64837afb07187b95212c2fb15bb7fd96c1200143"}
May 25 01:14:58.035650 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:58.035615    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x" event={"ID":"49de1bbd-0111-489a-bf0e-b526774936c0","Type":"ContainerStarted","Data":"78a9a7efbb69360116d907220cbaf4bf08bec13616a613dd4f2f522a6ab0277b"}
May 25 01:14:58.036037 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:14:58.035822    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:15:02.050583 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:02.050549    2575 generic.go:358] "Generic (PLEG): container finished" podID="906550ac-2a00-48c2-870c-61df6a4d92a4" containerID="2f1df76542df0f9de82b1a201b8b688b36e5410a02212c29cbd592ca48684e16" exitCode=0
May 25 01:15:02.051109 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:02.050613    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt" event={"ID":"906550ac-2a00-48c2-870c-61df6a4d92a4","Type":"ContainerDied","Data":"2f1df76542df0f9de82b1a201b8b688b36e5410a02212c29cbd592ca48684e16"}
May 25 01:15:02.068446 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:02.068401    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x" podStartSLOduration=14.897313294 podStartE2EDuration="15.068387611s" podCreationTimestamp="2026-05-25 01:14:47 +0000 UTC" firstStartedPulling="2026-05-25 01:14:57.031228809 +0000 UTC m=+762.821435394" lastFinishedPulling="2026-05-25 01:14:57.202303123 +0000 UTC m=+762.992509711" observedRunningTime="2026-05-25 01:14:58.05468702 +0000 UTC m=+763.844893629" watchObservedRunningTime="2026-05-25 01:15:02.068387611 +0000 UTC m=+767.858594221"
May 25 01:15:03.055865 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:03.055831    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt" event={"ID":"906550ac-2a00-48c2-870c-61df6a4d92a4","Type":"ContainerStarted","Data":"c279dfd9e8c87033a53b3da69423da5d272caa2c4b8f9c462920eefc2b21a1cf"}
May 25 01:15:03.056268 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:03.056053    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:15:03.072393 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:03.072338    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt" podStartSLOduration=7.671094393 podStartE2EDuration="8.072324365s" podCreationTimestamp="2026-05-25 01:14:55 +0000 UTC" firstStartedPulling="2026-05-25 01:15:02.05144276 +0000 UTC m=+767.841649351" lastFinishedPulling="2026-05-25 01:15:02.452672725 +0000 UTC m=+768.242879323" observedRunningTime="2026-05-25 01:15:03.071076043 +0000 UTC m=+768.861282651" watchObservedRunningTime="2026-05-25 01:15:03.072324365 +0000 UTC m=+768.862530972"
May 25 01:15:09.055019 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:09.054989    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x"
May 25 01:15:14.072348 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:15:14.072319    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt"
May 25 01:37:58.857275 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:37:58.857245    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-wjdsp_217a2d1a-60ce-498a-9773-a16a1cf602ac/manager/0.log"
May 25 01:37:59.415751 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:37:59.415724    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4mwpf_57b5b852-f240-44a9-9c38-d696ff2ec06a/manager/2.log"
May 25 01:37:59.735380 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:37:59.735298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-wvwxq_7cc1c399-480f-4742-a571-21941d18cb0f/manager/0.log"
May 25 01:38:01.148101 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:01.148068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dn7c4_f8a46147-2a32-4464-9f8b-251587cbffb2/manager/0.log"
May 25 01:38:01.251535 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:01.251483    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ml7jp_b009302c-d928-4180-8c53-039fad93a9ff/manager/0.log"
May 25 01:38:01.795801 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:01.795759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xmbl9_c8b5a199-f7ef-4e65-887a-276bdabbc9f6/manager/0.log"
May 25 01:38:02.226177 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:02.226150    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-sqdkv_efd6637b-d805-4297-9b72-7262ace63af8/discovery/0.log"
May 25 01:38:02.424818 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:02.424766    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b48c6bb9-tpd75_fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3/kube-auth-proxy/0.log"
May 25 01:38:03.291845 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.291819    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-jr5gb_f6f55370-cf2a-4806-8c3a-94b0d21f6728/storage-initializer/0.log"
May 25 01:38:03.298325 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.298307    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-jr5gb_f6f55370-cf2a-4806-8c3a-94b0d21f6728/main/0.log"
May 25 01:38:03.399830 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.399800    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt_906550ac-2a00-48c2-870c-61df6a4d92a4/storage-initializer/0.log"
May 25 01:38:03.406111 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.406089    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc99nbt_906550ac-2a00-48c2-870c-61df6a4d92a4/main/0.log"
May 25 01:38:03.615193 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.615164    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x_49de1bbd-0111-489a-bf0e-b526774936c0/storage-initializer/0.log"
May 25 01:38:03.621491 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:03.621468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-6ch6x_49de1bbd-0111-489a-bf0e-b526774936c0/main/0.log"
May 25 01:38:10.398643 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:10.398610    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dgd8t_3288dcbd-fbb7-48c8-91d4-14f7dc09dc3e/global-pull-secret-syncer/0.log"
May 25 01:38:10.510217 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:10.510187    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qtxsg_8ea42f20-679e-47ed-934d-750480d95a60/konnectivity-agent/0.log"
May 25 01:38:10.612629 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:10.612603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-62.ec2.internal_9967a8879fa48b19b7c0f1227c168553/haproxy/0.log"
May 25 01:38:14.707556 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:14.707523    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-dn7c4_f8a46147-2a32-4464-9f8b-251587cbffb2/manager/0.log"
May 25 01:38:14.733004 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:14.732983    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-ml7jp_b009302c-d928-4180-8c53-039fad93a9ff/manager/0.log"
May 25 01:38:14.947904 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:14.947876    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xmbl9_c8b5a199-f7ef-4e65-887a-276bdabbc9f6/manager/0.log"
May 25 01:38:16.810694 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:16.810651    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj5pj_da883c0b-ff87-41d2-a746-41871a3953c2/node-exporter/0.log"
May 25 01:38:16.829907 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:16.829885    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj5pj_da883c0b-ff87-41d2-a746-41871a3953c2/kube-rbac-proxy/0.log"
May 25 01:38:16.850639 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:16.850619    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj5pj_da883c0b-ff87-41d2-a746-41871a3953c2/init-textfile/0.log"
May 25 01:38:18.838925 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.838894    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"]
May 25 01:38:18.842405 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.842381    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:18.845013 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.844992    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jj4g\"/\"default-dockercfg-mcntr\""
May 25 01:38:18.845126 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.845051    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"openshift-service-ca.crt\""
May 25 01:38:18.845126 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.845059    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"kube-root-ca.crt\""
May 25 01:38:18.849369 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.849140    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"]
May 25 01:38:18.914573 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.914541    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-podres\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:18.914761 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.914597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdr4\" (UniqueName: \"kubernetes.io/projected/3900ca00-ed3e-45f5-8236-bc7ed43734fc-kube-api-access-xkdr4\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:18.914761 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.914624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-proc\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:18.914761 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.914715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-lib-modules\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:18.914934 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:18.914806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-sys\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015694 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015657    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-sys\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015716    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-podres\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015769    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdr4\" (UniqueName: \"kubernetes.io/projected/3900ca00-ed3e-45f5-8236-bc7ed43734fc-kube-api-access-xkdr4\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015791    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-sys\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015809    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-proc\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015856    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-proc\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.015883 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015876    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-lib-modules\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.016143 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.015950    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-podres\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.016143 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.016024    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3900ca00-ed3e-45f5-8236-bc7ed43734fc-lib-modules\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.026187 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.026159    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdr4\" (UniqueName: \"kubernetes.io/projected/3900ca00-ed3e-45f5-8236-bc7ed43734fc-kube-api-access-xkdr4\") pod \"perf-node-gather-daemonset-rlpnh\" (UID: \"3900ca00-ed3e-45f5-8236-bc7ed43734fc\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.152481 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.152449    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.277293 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.277268    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"]
May 25 01:38:19.279945 ip-10-0-142-62 kubenswrapper[2575]: W0525 01:38:19.279913    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3900ca00_ed3e_45f5_8236_bc7ed43734fc.slice/crio-28917ec5bf83ba9731598f6cc94f1e4e03adbfa806d9fd75bbe97c9fa82f9e63 WatchSource:0}: Error finding container 28917ec5bf83ba9731598f6cc94f1e4e03adbfa806d9fd75bbe97c9fa82f9e63: Status 404 returned error can't find the container with id 28917ec5bf83ba9731598f6cc94f1e4e03adbfa806d9fd75bbe97c9fa82f9e63
May 25 01:38:19.281438 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.281418    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:38:19.681906 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.681869    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh" event={"ID":"3900ca00-ed3e-45f5-8236-bc7ed43734fc","Type":"ContainerStarted","Data":"04e9aff82104c4e84f4ed4288bf2587a190f1620146dd6f19529be69d25186f8"}
May 25 01:38:19.681906 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.681904    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh" event={"ID":"3900ca00-ed3e-45f5-8236-bc7ed43734fc","Type":"ContainerStarted","Data":"28917ec5bf83ba9731598f6cc94f1e4e03adbfa806d9fd75bbe97c9fa82f9e63"}
May 25 01:38:19.682157 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.681988    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:19.698733 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:19.698686    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh" podStartSLOduration=1.698670463 podStartE2EDuration="1.698670463s" podCreationTimestamp="2026-05-25 01:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:38:19.696356754 +0000 UTC m=+2165.486563360" watchObservedRunningTime="2026-05-25 01:38:19.698670463 +0000 UTC m=+2165.488877101"
May 25 01:38:21.108809 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:21.108763    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2n7v_c5ca3a91-e04d-4d2e-8677-90357d07d24d/dns/0.log"
May 25 01:38:21.128174 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:21.128148    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2n7v_c5ca3a91-e04d-4d2e-8677-90357d07d24d/kube-rbac-proxy/0.log"
May 25 01:38:21.171519 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:21.171491    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tn97q_a32d2fe2-8269-4821-a1d1-8e5660df3c06/dns-node-resolver/0.log"
May 25 01:38:21.666691 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:21.666654    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hfwxg_6bce79ad-13fe-4feb-a06c-394b87713f64/node-ca/0.log"
May 25 01:38:22.616563 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:22.616534    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-sqdkv_efd6637b-d805-4297-9b72-7262ace63af8/discovery/0.log"
May 25 01:38:22.655816 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:22.655764    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b48c6bb9-tpd75_fa4eada9-01aa-4bc0-ab9d-4a82aabf7bc3/kube-auth-proxy/0.log"
May 25 01:38:23.291436 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:23.291405    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84nsk_b9d37131-d722-441a-9bbd-1eab6d47194b/serve-healthcheck-canary/0.log"
May 25 01:38:23.863685 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:23.863655    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc5qg_48b8850f-02a4-4cd4-a048-0779140cc10d/kube-rbac-proxy/0.log"
May 25 01:38:23.884099 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:23.884066    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc5qg_48b8850f-02a4-4cd4-a048-0779140cc10d/exporter/0.log"
May 25 01:38:23.904288 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:23.904268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lc5qg_48b8850f-02a4-4cd4-a048-0779140cc10d/extractor/0.log"
May 25 01:38:25.694803 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:25.694761    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-rlpnh"
May 25 01:38:25.778964 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:25.778929    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-wjdsp_217a2d1a-60ce-498a-9773-a16a1cf602ac/manager/0.log"
May 25 01:38:25.933508 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:25.933483    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4mwpf_57b5b852-f240-44a9-9c38-d696ff2ec06a/manager/1.log"
May 25 01:38:25.944328 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:25.944298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-4mwpf_57b5b852-f240-44a9-9c38-d696ff2ec06a/manager/2.log"
May 25 01:38:26.035496 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:26.035418    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-wvwxq_7cc1c399-480f-4742-a571-21941d18cb0f/manager/0.log"
May 25 01:38:27.201038 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:27.200998    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-dqtfh_2041cd51-691e-4730-ad1d-14d91e8cb85e/openshift-lws-operator/0.log"
May 25 01:38:33.135240 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.135208    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-82jwn_4b44482d-18d6-448e-a580-da06c5e9e72a/kube-multus/0.log"
May 25 01:38:33.301184 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.301158    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/kube-multus-additional-cni-plugins/0.log"
May 25 01:38:33.320464 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.320441    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/egress-router-binary-copy/0.log"
May 25 01:38:33.339414 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.339392    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/cni-plugins/0.log"
May 25 01:38:33.360363 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.360339    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/bond-cni-plugin/0.log"
May 25 01:38:33.381455 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.381437    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/routeoverride-cni/0.log"
May 25 01:38:33.400074 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.400022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/whereabouts-cni-bincopy/0.log"
May 25 01:38:33.419032 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.419011    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wrq4z_c9183920-32a1-4962-8487-5bc7818d4356/whereabouts-cni/0.log"
May 25 01:38:33.619896 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.619868    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zghqp_6b674d77-e2fe-4a63-a09a-29fa01243f3e/network-metrics-daemon/0.log"
May 25 01:38:33.637284 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:33.637258    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zghqp_6b674d77-e2fe-4a63-a09a-29fa01243f3e/kube-rbac-proxy/0.log"
May 25 01:38:34.733411 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.733370    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/ovn-controller/0.log"
May 25 01:38:34.761194 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.761165    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/ovn-acl-logging/0.log"
May 25 01:38:34.779201 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.779172    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/kube-rbac-proxy-node/0.log"
May 25 01:38:34.802663 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.802637    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/kube-rbac-proxy-ovn-metrics/0.log"
May 25 01:38:34.820881 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.820856    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/northd/0.log"
May 25 01:38:34.840843 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.840821    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/nbdb/0.log"
May 25 01:38:34.860300 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.860279    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/sbdb/0.log"
May 25 01:38:34.950189 ip-10-0-142-62 kubenswrapper[2575]: I0525 01:38:34.950158    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mmvhx_2140cd91-dd9d-49b9-b9fb-7ec7caa5656e/ovnkube-controller/0.log"