May 26 19:37:39.818827 ip-10-0-137-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 19:37:39.818839 ip-10-0-137-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 19:37:39.818847 ip-10-0-137-200 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 19:37:39.819073 ip-10-0-137-200 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 19:37:50.860791 ip-10-0-137-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 19:37:50.860812 ip-10-0-137-200 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4d9610c9ff6243eab33c83806115334a --
May 26 19:40:25.377265 ip-10-0-137-200 systemd[1]: Starting Kubernetes Kubelet...
May 26 19:40:25.906426 ip-10-0-137-200 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:25.906426 ip-10-0-137-200 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 19:40:25.906426 ip-10-0-137-200 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:25.906426 ip-10-0-137-200 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 19:40:25.906426 ip-10-0-137-200 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:25.908962 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.908848    2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915806    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915830    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915834    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915837    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915840    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915843    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915846    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:25.915836 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915849    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915853    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915856    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915859    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915864    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915868    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915871    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915873    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915876    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915878    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915880    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915883    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915886    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915888    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915890    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915893    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915895    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915898    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915901    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915925    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:25.916143 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915928    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915931    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915933    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915936    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915938    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915941    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915943    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915946    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915948    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915951    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915953    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915957    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915959    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915962    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915965    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915967    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915970    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915973    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915975    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915978    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:25.916602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915980    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915983    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915985    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915988    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915990    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915993    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915995    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.915997    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916000    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916002    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916004    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916007    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916009    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916012    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916014    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916016    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916019    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916021    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916023    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:25.917123 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916026    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916028    2561 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916031    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916033    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916035    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916039    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916042    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916045    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916049    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916053    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916057    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916059    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916068    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916071    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916073    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916082    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916084    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916087    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916089    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916092    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:25.917602 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916513    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916517    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916520    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916523    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916526    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916528    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916531    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916533    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916536    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916538    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916541    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916543    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916545    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916548    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916550    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916553    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916555    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916558    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916560    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916564    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:25.918098 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916566    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916569    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916572    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916576    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916584    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916587    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916589    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916592    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916594    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916597    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916599    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916602    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916604    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916607    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916609    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916612    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916615    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916618    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916621    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916623    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:25.918613 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916626    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916628    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916631    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916633    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916635    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916638    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916640    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916643    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916645    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916648    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916651    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916653    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916656    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916658    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916661    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916663    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916665    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916673    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916676    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:25.919121 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916678    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916681    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916684    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916686    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916688    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916691    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916694    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916698    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916701    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916704    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916707    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916710    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916712    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916716    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916719    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916721    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916724    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916727    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916729    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:25.919570 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916732    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916734    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916736    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916739    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916741    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916744    2561 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916747    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.916749    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917409    2561 flags.go:64] FLAG: --address="0.0.0.0"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917420    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917428    2561 flags.go:64] FLAG: --anonymous-auth="true"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917432    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917444    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917447    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917452    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917457    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917460    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917463    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917467    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917470    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917474    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917477    2561 flags.go:64] FLAG: --cgroup-root=""
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917480    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 19:40:25.920033 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917483    2561 flags.go:64] FLAG: --client-ca-file=""
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917486    2561 flags.go:64] FLAG: --cloud-config=""
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917489    2561 flags.go:64] FLAG: --cloud-provider="external"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917492    2561 flags.go:64] FLAG: --cluster-dns="[]"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917498    2561 flags.go:64] FLAG: --cluster-domain=""
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917501    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917504    2561 flags.go:64] FLAG: --config-dir=""
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917507    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917511    2561 flags.go:64] FLAG: --container-log-max-files="5"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917514    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917517    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917521    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917524    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917527    2561 flags.go:64] FLAG: --contention-profiling="false"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917530    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917533    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917536    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917539    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917543    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917546    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917549    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917552    2561 flags.go:64] FLAG: --enable-load-reader="false"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917561    2561 flags.go:64] FLAG: --enable-server="true"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917563    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917570    2561 flags.go:64] FLAG: --event-burst="100"
May 26 19:40:25.920569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917574    2561 flags.go:64] FLAG: --event-qps="50"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917577    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917580    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917583    2561 flags.go:64] FLAG: --eviction-hard=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917587    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917590    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917593    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917598    2561 flags.go:64] FLAG: --eviction-soft=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917601    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917604    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917607    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917610    2561 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917613    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917616    2561 flags.go:64] FLAG: --fail-swap-on="true"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917619    2561 flags.go:64] FLAG: --feature-gates=""
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917623    2561 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917626    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917629    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917632    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917635    2561 flags.go:64] FLAG: --healthz-port="10248"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917638    2561 flags.go:64] FLAG: --help="false"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917643    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-200.ec2.internal"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917646    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917649    2561 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 19:40:25.921175 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917651    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917655    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917658    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917661    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917664    2561 flags.go:64] FLAG: --image-service-endpoint=""
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917667    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917673    2561 flags.go:64] FLAG: --kube-api-burst="100"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917675    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917679    2561 flags.go:64] FLAG: --kube-api-qps="50"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917681    2561 flags.go:64] FLAG: --kube-reserved=""
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917684    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917687    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917690    2561 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917692    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917695    2561 flags.go:64] FLAG: --lock-file=""
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917699    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917702    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917705    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917710    2561 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917713    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917716    2561 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917719    2561 flags.go:64] FLAG: --logging-format="text"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917722    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917725    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 19:40:25.921832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917728    2561 flags.go:64] FLAG: --manifest-url=""
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917731    2561 flags.go:64] FLAG: --manifest-url-header=""
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917735    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917738    2561 flags.go:64] FLAG: --max-open-files="1000000"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917743    2561 flags.go:64] FLAG: --max-pods="110"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917747    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917750    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917753    2561 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917756    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917760    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917763    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917766    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917773    2561 flags.go:64] FLAG: --node-status-max-images="50"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917776    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917779    2561 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917783    2561 flags.go:64] FLAG: --pod-cidr=""
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917787    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917792    2561 flags.go:64] FLAG: --pod-manifest-path=""
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917795    2561 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917798    2561 flags.go:64] FLAG: --pods-per-core="0"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917801    2561 flags.go:64] FLAG: --port="10250"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917804    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917807    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0750aa1753b0cc1a1"
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917810    2561 flags.go:64] FLAG: --qos-reserved=""
May 26 19:40:25.922441 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917814    2561 flags.go:64] FLAG: --read-only-port="10255"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917817    2561 flags.go:64] FLAG: --register-node="true"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917820    2561 flags.go:64] FLAG: --register-schedulable="true"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917823    2561 flags.go:64] FLAG: --register-with-taints=""
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917826    2561 flags.go:64] FLAG: --registry-burst="10"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917829    2561 flags.go:64] FLAG: --registry-qps="5"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917832    2561 flags.go:64] FLAG: --reserved-cpus=""
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917834    2561 flags.go:64] FLAG: --reserved-memory=""
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917838    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917841    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917844    2561 flags.go:64] FLAG: --rotate-certificates="false"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917847    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917850    2561 flags.go:64] FLAG: --runonce="false"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917854    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917857    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917860    2561 flags.go:64] FLAG: --seccomp-default="false"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917863    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917866    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917869    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917872    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917875    2561 flags.go:64] FLAG: --storage-driver-password="root"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917878    2561 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917881    2561 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917883    2561 flags.go:64] FLAG: --storage-driver-user="root"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917887    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917890    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 19:40:25.923026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917893    2561 flags.go:64] FLAG: --system-cgroups=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917896    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917902    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917904    2561 flags.go:64] FLAG: --tls-cert-file=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917919    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917926    2561 flags.go:64] FLAG: --tls-min-version=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917930    2561 flags.go:64] FLAG: --tls-private-key-file=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917933    2561 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917936    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917939    2561 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917942    2561 flags.go:64] FLAG: --v="2"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917946    2561 flags.go:64] FLAG: --version="false"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917950    2561 flags.go:64] FLAG: --vmodule=""
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917954    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.917957    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918089    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918092    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918096    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918099    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918104    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918107    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918110    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918113    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:25.923687 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918115    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918118    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918121    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918123    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918125    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918129    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918131    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918133    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918141    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918144    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918147    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918149    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918152    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918154    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918156    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918160    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918162    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918164    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918167    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918169    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:25.924240 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918172    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918174    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918177    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918179    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918182    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918184    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918189    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918191    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918195    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918198    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918200    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918202    2561 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918206    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918210    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918213    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918216    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918218    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918221    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918225    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:25.924726 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918228    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918231    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918233    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918236    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918239    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918241    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918243    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918246    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918249    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918251    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918254    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918257    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918259    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918262    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918265    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918267    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918270    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918272    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918275    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918277    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:25.925242 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918280    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918284    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918286    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918288    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918291    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918294    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918296    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918299    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918301    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918304    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918306    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918308    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918311    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918313    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918316    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918319    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918334    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918337    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:25.925732 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.918339    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.918344    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.925083    2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.925102    2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925152    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925158    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925161    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925164    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925167    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925171    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925174    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925184    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925188    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925191    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925194    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925196    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:25.926209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925199    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925201    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925204    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925207    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925229    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925233    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925236    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925239    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925242    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925245    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925248    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925250    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925253    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925256    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925259    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925261    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925264    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925266    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925269    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:25.926620 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925273    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925276    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925279    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925281    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925283    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925286    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925289    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925291    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925294    2561 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925296    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925299    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925301    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925304    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925306    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925309    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925311    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925314    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925316    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925318    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:25.927100 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925321    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925323    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925326    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925329    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925331    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925333    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925336    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925338    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925341    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925344    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925346    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925349    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925351    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925356    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925359    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925361    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925364    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925366    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925369    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925371    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:25.927548 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925374    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925378    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925382    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925385    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925388    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925391    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925393    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925396    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925399    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925402    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925405    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925408    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925410    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925413    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925416    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:25.928050 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925418    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.925423    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925532    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925538    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925542    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925545    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925548    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925551    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925553    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925556    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925559    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925561    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925564    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925567    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925569    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925571    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:25.928413 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925574    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925576    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925579    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925581    2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925583    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925586    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925588    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925592    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925596    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925599    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925602    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925604    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925607    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925609    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925612    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925615    2561 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925617    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925619    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925622    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925625    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:25.928789 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925627    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925630    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925632    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925635    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925637    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925640    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925642    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925644    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925647    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925650    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925652    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925656    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925659    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925662    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925665    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925668    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925670    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925673    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925676    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:25.929298 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925679    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925681    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925684    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925687    2561 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925690    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925692    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925695    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925697    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925700    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925702    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925704    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925707    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925710    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925712    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925715    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925717    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925720    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925722    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925725    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925727    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:25.929838 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925729    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925732    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925734    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925738    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925740    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925743    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925746    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925749    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925751    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925753    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925756    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925759    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:25.925761    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.925766    2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:25.930368 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.926609    2561 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 19:40:25.931413 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.931397    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 19:40:25.932571 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.932559    2561 server.go:1019] "Starting client certificate rotation"
May 26 19:40:25.933045 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.933027    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:40:25.933077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.933064    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:40:25.964035 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.964011    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:40:25.969574 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.968784    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:40:25.986222 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.986196    2561 log.go:25] "Validated CRI v1 runtime API"
May 26 19:40:25.991775 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.991756    2561 log.go:25] "Validated CRI v1 image API"
May 26 19:40:25.993184 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.993156    2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 19:40:25.999997 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.999972    2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af183211-42df-42f3-865b-da106b27bb44:/dev/nvme0n1p4 ec21244f-cdc2-4679-a597-539440e929dc:/dev/nvme0n1p3]
May 26 19:40:26.000079 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:25.999994    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 19:40:26.001104 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.001083    2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:40:26.004457 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.004340    2561 manager.go:217] Machine: {Timestamp:2026-05-26 19:40:26.003805956 +0000 UTC m=+0.482953590 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3239490 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25414ea0060e601f5647120d9038cf SystemUUID:ec25414e-a006-0e60-1f56-47120d9038cf BootID:4d9610c9-ff62-43ea-b33c-83806115334a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:e6:20:cc:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:e6:20:cc:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:5d:fa:5d:d3:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 19:40:26.005254 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.005240    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 19:40:26.005350 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.005337    2561 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 19:40:26.007879 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.007844    2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 19:40:26.008090 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.007881    2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 19:40:26.008176 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.008105    2561 topology_manager.go:138] "Creating topology manager with none policy"
May 26 19:40:26.008176 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.008118    2561 container_manager_linux.go:306] "Creating device plugin manager"
May 26 19:40:26.008176 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.008128    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:40:26.008888 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.008876    2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:40:26.011681 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.011665    2561 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:40:26.011834 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.011822    2561 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 19:40:26.015401 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.015387    2561 kubelet.go:491] "Attempting to sync node with API server"
May 26 19:40:26.015469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.015409    2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 19:40:26.015469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.015428    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 19:40:26.015469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.015442    2561 kubelet.go:397] "Adding apiserver pod source"
May 26 19:40:26.015469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.015456    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 19:40:26.016955 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.016940    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:40:26.017018 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.016965    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:40:26.021020 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.021003    2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 19:40:26.022961 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.022948    2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 19:40:26.024869 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024856    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024875    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024881    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024894    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024902    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024925    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 19:40:26.024929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024931    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 19:40:26.025077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024938    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 19:40:26.025077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024945    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 19:40:26.025077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024951    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 19:40:26.025077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.024964    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 19:40:26.025340 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.025329    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 19:40:26.026708 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.026698    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 19:40:26.026740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.026708    2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 19:40:26.030089 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.030074    2561 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 19:40:26.030164 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.030116    2561 server.go:1295] "Started kubelet"
May 26 19:40:26.030247 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.030187    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 19:40:26.030699 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.030655    2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 19:40:26.030747 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.030719    2561 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 19:40:26.030967 ip-10-0-137-200 systemd[1]: Started Kubernetes Kubelet.
May 26 19:40:26.033263 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.033239    2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 19:40:26.039246 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.039223    2561 server.go:317] "Adding debug handlers to kubelet server"
May 26 19:40:26.040241 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.040219    2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 19:40:26.040731 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.040449    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 19:40:26.040818 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.040562    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 19:40:26.045319 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.044353    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-200.ec2.internal.18b334e2b4163d92  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-200.ec2.internal,UID:ip-10-0-137-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-200.ec2.internal,},FirstTimestamp:2026-05-26 19:40:26.03008757 +0000 UTC m=+0.509235205,LastTimestamp:2026-05-26 19:40:26.03008757 +0000 UTC m=+0.509235205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-200.ec2.internal,}"
May 26 19:40:26.046057 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.046026    2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 19:40:26.048597 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.048443    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmvm5"
May 26 19:40:26.048597 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.048459    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 19:40:26.049158 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049131    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 19:40:26.049657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049332    2561 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 19:40:26.049657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049348    2561 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 19:40:26.049657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049381    2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 19:40:26.049657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049469    2561 reconstruct.go:97] "Volume reconstruction finished"
May 26 19:40:26.049657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049477    2561 reconciler.go:26] "Reconciler: start to sync state"
May 26 19:40:26.049941 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049796    2561 factory.go:55] Registering systemd factory
May 26 19:40:26.049941 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.049811    2561 factory.go:223] Registration of the systemd container factory successfully
May 26 19:40:26.050064 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050047    2561 factory.go:153] Registering CRI-O factory
May 26 19:40:26.050128 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050066    2561 factory.go:223] Registration of the crio container factory successfully
May 26 19:40:26.050174 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.050127    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.050174 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050167    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 19:40:26.050244 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050186    2561 factory.go:103] Registering Raw factory
May 26 19:40:26.050244 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050203    2561 manager.go:1196] Started watching for new ooms in manager
May 26 19:40:26.050650 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.050624    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 19:40:26.050650 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.050641    2561 manager.go:319] Starting recovery of all containers
May 26 19:40:26.050811 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.050787    2561 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 19:40:26.054760 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.054682    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmvm5"
May 26 19:40:26.060351 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.060334    2561 manager.go:324] Recovery completed
May 26 19:40:26.064325 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.064312    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.067331 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067316    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.067405 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067344    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.067405 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067354    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.067854 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067837    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 19:40:26.067854 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067853    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 19:40:26.067977 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.067873    2561 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:40:26.070745 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.070731    2561 policy_none.go:49] "None policy: Start"
May 26 19:40:26.070778 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.070750    2561 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 19:40:26.070778 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.070761    2561 state_mem.go:35] "Initializing new in-memory state store"
May 26 19:40:26.105611 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.105585    2561 manager.go:341] "Starting Device Plugin manager"
May 26 19:40:26.105765 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.105627    2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 19:40:26.105765 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.105641    2561 server.go:85] "Starting device plugin registration server"
May 26 19:40:26.105969 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.105954    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 19:40:26.106036 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.105973    2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 19:40:26.106085 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.106049    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 19:40:26.106141 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.106128    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 19:40:26.106186 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.106144    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 19:40:26.106738 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.106712    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 19:40:26.106821 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.106766    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.126130 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.126087    2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 19:40:26.130646 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.127409    2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 19:40:26.130646 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.127443    2561 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 19:40:26.130646 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.127465    2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 19:40:26.130646 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.127476    2561 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 19:40:26.130646 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.127514    2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 19:40:26.131434 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.131415    2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:26.206995 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.206969    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.208135 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.208118    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.208225 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.208147    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.208225 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.208159    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.208225 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.208191    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-200.ec2.internal"
May 26 19:40:26.217599 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.217578    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-200.ec2.internal"
May 26 19:40:26.217689 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.217610    2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-200.ec2.internal\": node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.227673 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.227653    2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"]
May 26 19:40:26.227750 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.227716    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.228512 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.228495    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.228593 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.228523    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.228593 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.228532    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.229987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.229974    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.230165 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230149    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.230231 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230221    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.230688 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230662    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.230777 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230696    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.230777 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230711    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.230859 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230845    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.230901 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230878    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.230901 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.230890    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.231881 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.231866    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.231981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.231891    2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:26.232155 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.232140    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.232456 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.232439    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:26.232549 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.232469    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:26.232549 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.232482    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:26.247539 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.247515    2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-200.ec2.internal\" not found" node="ip-10-0-137-200.ec2.internal"
May 26 19:40:26.251491 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.251474    2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-200.ec2.internal\" not found" node="ip-10-0-137-200.ec2.internal"
May 26 19:40:26.333067 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.333037    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.350338 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.350319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.350428 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.350350    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.350428 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.350368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c66f86e1ffcc081e15ecdd4acdb9df2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-200.ec2.internal\" (UID: \"c66f86e1ffcc081e15ecdd4acdb9df2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.433480 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.433456    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.450765 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450740    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.450820 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450772    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.450820 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450788    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c66f86e1ffcc081e15ecdd4acdb9df2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-200.ec2.internal\" (UID: \"c66f86e1ffcc081e15ecdd4acdb9df2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.450881 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450833    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.450881 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450829    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd6d1db0798aad8547007cf11dfd824b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal\" (UID: \"dd6d1db0798aad8547007cf11dfd824b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.450963 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.450877    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c66f86e1ffcc081e15ecdd4acdb9df2b-config\") pod \"kube-apiserver-proxy-ip-10-0-137-200.ec2.internal\" (UID: \"c66f86e1ffcc081e15ecdd4acdb9df2b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.534227 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.534132    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.550362 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.550333    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.555060 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.555034    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:26.635200 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.635167    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.735655 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.735609    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.836192 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.836102    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.874141 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.874110    2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:26.932284 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.932244    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 19:40:26.932992 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.932401    2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:40:26.932992 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.932434    2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:40:26.936400 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:26.936375    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:26.993834 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:26.993797    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66f86e1ffcc081e15ecdd4acdb9df2b.slice/crio-e2866bf3cb16f9774920c2449e0f9c4183d1715272e697316e65e3628e27a87e WatchSource:0}: Error finding container e2866bf3cb16f9774920c2449e0f9c4183d1715272e697316e65e3628e27a87e: Status 404 returned error can't find the container with id e2866bf3cb16f9774920c2449e0f9c4183d1715272e697316e65e3628e27a87e
May 26 19:40:26.994064 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:26.994048    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6d1db0798aad8547007cf11dfd824b.slice/crio-f96384432e74ddc1789604f045739e65da25493eeda2b73afbb0559a4707217d WatchSource:0}: Error finding container f96384432e74ddc1789604f045739e65da25493eeda2b73afbb0559a4707217d: Status 404 returned error can't find the container with id f96384432e74ddc1789604f045739e65da25493eeda2b73afbb0559a4707217d
May 26 19:40:27.000575 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:26.999785    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:40:27.037133 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:27.037098    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:27.048818 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.048797    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 19:40:27.056839 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.056811    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:35:26 +0000 UTC" deadline="2027-11-22 13:54:34.174451342 +0000 UTC"
May 26 19:40:27.056839 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.056836    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13074h14m7.117618407s"
May 26 19:40:27.059290 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.059272    2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:40:27.084857 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.084830    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9zg9b"
May 26 19:40:27.093567 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.093515    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9zg9b"
May 26 19:40:27.131174 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.131124    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal" event={"ID":"dd6d1db0798aad8547007cf11dfd824b","Type":"ContainerStarted","Data":"f96384432e74ddc1789604f045739e65da25493eeda2b73afbb0559a4707217d"}
May 26 19:40:27.132100 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.132077    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal" event={"ID":"c66f86e1ffcc081e15ecdd4acdb9df2b","Type":"ContainerStarted","Data":"e2866bf3cb16f9774920c2449e0f9c4183d1715272e697316e65e3628e27a87e"}
May 26 19:40:27.136828 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.136808    2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:27.137326 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:27.137310    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:27.237502 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:27.237466    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:27.338032 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:27.337990    2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-200.ec2.internal\" not found"
May 26 19:40:27.409786 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.409708    2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:27.450080 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.450048    2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal"
May 26 19:40:27.468740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.468705    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:27.469881 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.469856    2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal"
May 26 19:40:27.484308 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.484275    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:27.943364 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:27.943331    2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:28.016588 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.016553    2561 apiserver.go:52] "Watching apiserver"
May 26 19:40:28.026400 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.026368    2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 19:40:28.026823 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.026789    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-7h4nj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal","openshift-multus/multus-fc6dv","openshift-multus/network-metrics-daemon-854dh","openshift-ovn-kubernetes/ovnkube-node-5jf8m","kube-system/konnectivity-agent-v6njc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84","openshift-cluster-node-tuning-operator/tuned-65nlr","openshift-multus/multus-additional-cni-plugins-c8t7g","openshift-network-diagnostics/network-check-target-kvrzg","openshift-network-operator/iptables-alerter-rt4fj","kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal","openshift-dns/node-resolver-f7brn"]
May 26 19:40:28.028702 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.028677    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.030574 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.030550    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.031194 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.031167    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 19:40:28.031295 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.031212    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 19:40:28.031295 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.031213    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 19:40:28.031376 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.031295    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xmslq\""
May 26 19:40:28.031977 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.031959    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.032292 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.032082    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:28.033080 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.033059    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 19:40:28.033206 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.033100    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 19:40:28.033533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.033511    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 19:40:28.033624 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.033583    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 19:40:28.033680 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.033583    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8q4cz\""
May 26 19:40:28.035681 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.035181    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.035681 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.035295    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.037456 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.037435    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6txgs\""
May 26 19:40:28.037561 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.037537    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 19:40:28.037945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.037927    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 19:40:28.038030 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.038004    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 19:40:28.038157 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.038136    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 19:40:28.038223 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.038192    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 19:40:28.038223 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.038196    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.038756 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.038616    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 19:40:28.039113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.039096    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 19:40:28.039196 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.039097    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 19:40:28.039196 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.039096    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6x9qs\""
May 26 19:40:28.040709 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.040687    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kq5pj\""
May 26 19:40:28.041087 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.041068    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.041687 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.041661    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 19:40:28.042151 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.042132    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 19:40:28.042241 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.042213    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 19:40:28.043823 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.043803    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.043931 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.043831    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:28.045073 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.044614    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:28.045073 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.044897    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 19:40:28.045073 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.045004    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7hx42\""
May 26 19:40:28.045424 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.045406    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 19:40:28.046255 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.046237    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.046610 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.046592    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 19:40:28.046904 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.046886    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w62ql\""
May 26 19:40:28.046995 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.046956    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 19:40:28.048171 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.048151    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.048892 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.048872    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 19:40:28.049001 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.048876    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 19:40:28.049375 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.049348    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 19:40:28.049453 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.049349    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-97bsm\""
May 26 19:40:28.050499 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.050473    2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 19:40:28.050590 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.050508    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 19:40:28.051047 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.050702    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zpr6g\""
May 26 19:40:28.051047 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.050931    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 19:40:28.058341 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-device-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.058459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-cnibin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-multus\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058403    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-daemon-config\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-etc-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-netd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-env-overrides\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff80e3-824f-4dba-aa05-e54633132373-agent-certs\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-sys-fs\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058572    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-system-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-script-lib\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.058649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nszf\" (UniqueName: \"kubernetes.io/projected/729e6bef-49f5-453b-83cd-601759cf885d-kube-api-access-5nszf\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058681    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-tuned\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-iptables-alerter-script\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2xd\" (UniqueName: \"kubernetes.io/projected/b0060e8e-2124-4e14-beef-9cdd53f410a1-kube-api-access-9z2xd\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-sys\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-registration-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-kubelet\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jdzr\" (UniqueName: \"kubernetes.io/projected/04790958-b52a-4e74-b3e1-9ee83cf04710-kube-api-access-6jdzr\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.058987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.058979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-os-release\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-conf-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-multus-certs\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-config\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-systemd\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-run\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059246    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-system-cni-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-host-slash\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.059344 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-bin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-os-release\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059419    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2929769-702f-4c06-aab9-acf091e3270a-ovn-node-metrics-cert\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/729e6bef-49f5-453b-83cd-601759cf885d-host\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-lib-modules\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5js\" (UniqueName: \"kubernetes.io/projected/5f2d4b86-b93f-4e08-bf82-dedef40715f2-kube-api-access-nv5js\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059568    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0060e8e-2124-4e14-beef-9cdd53f410a1-tmp-dir\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-cni-binary-copy\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-slash\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059672    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-conf\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.059695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-kubelet\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059760    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-var-lib-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-var-lib-kubelet\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-etc-kubernetes\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8t4m\" (UniqueName: \"kubernetes.io/projected/97106aed-260f-4660-9104-3cc42b40f829-kube-api-access-x8t4m\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059948    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkl2\" (UniqueName: \"kubernetes.io/projected/a2929769-702f-4c06-aab9-acf091e3270a-kube-api-access-zjkl2\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.059997    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-netns\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-hostroot\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-netns\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060149    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-systemd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060239 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-ovn\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-modprobe-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-tmp\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff80e3-824f-4dba-aa05-e54633132373-konnectivity-ca\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-node-log\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-kubernetes\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-host\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlnhx\" (UniqueName: \"kubernetes.io/projected/bca0cc84-f86a-4950-ba65-0416612fbcd5-kube-api-access-wlnhx\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kube-api-access-jj2kc\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060400    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-socket-dir-parent\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060421    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysconfig\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060449    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbg2\" (UniqueName: \"kubernetes.io/projected/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-kube-api-access-jqbg2\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0060e8e-2124-4e14-beef-9cdd53f410a1-hosts-file\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-k8s-cni-cncf-io\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-systemd-units\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060538    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.060801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-bin\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.061468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-cnibin\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.061468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060600    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-socket-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.061468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060615    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.061468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060630    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-log-socket\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.061468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.060645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/729e6bef-49f5-453b-83cd-601759cf885d-serviceca\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.094389 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.094333    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:35:27 +0000 UTC" deadline="2027-11-16 04:43:10.845914626 +0000 UTC"
May 26 19:40:28.094389 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.094365    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12921h2m42.751553258s"
May 26 19:40:28.161367 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161329    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161367 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161370    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-conf\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161390    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161410    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-kubelet\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161435    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-var-lib-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161457    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-var-lib-kubelet\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161480    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161491    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-kubelet\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161505    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161541    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-conf\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161552    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161541    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysctl-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161556    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-etc-kubernetes\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161591    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-etc-kubernetes\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161594    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-var-lib-kubelet\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161597    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8t4m\" (UniqueName: \"kubernetes.io/projected/97106aed-260f-4660-9104-3cc42b40f829-kube-api-access-x8t4m\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.161622 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161633    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-var-lib-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161663    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkl2\" (UniqueName: \"kubernetes.io/projected/a2929769-702f-4c06-aab9-acf091e3270a-kube-api-access-zjkl2\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161796    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161825    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.161871    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162000    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162035    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162061    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-netns\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.162302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162196    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162377    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-netns\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162409    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-hostroot\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162433    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-netns\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162455    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-systemd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162458    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-hostroot\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162474    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-ovn\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162496    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-modprobe-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162512    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-netns\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162521    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-tmp\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162546    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff80e3-824f-4dba-aa05-e54633132373-konnectivity-ca\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162558    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-systemd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162571    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-node-log\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162581    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-ovn\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162594    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-kubernetes\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.162620 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162605    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-modprobe-d\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162633    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-host\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162648    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-kubernetes\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162661    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlnhx\" (UniqueName: \"kubernetes.io/projected/bca0cc84-f86a-4950-ba65-0416612fbcd5-kube-api-access-wlnhx\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162691    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kube-api-access-jj2kc\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162693    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-node-log\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162719    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-socket-dir-parent\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162745    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysconfig\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162773    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbg2\" (UniqueName: \"kubernetes.io/projected/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-kube-api-access-jqbg2\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162798    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0060e8e-2124-4e14-beef-9cdd53f410a1-hosts-file\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162821    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-k8s-cni-cncf-io\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162839    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162884    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-systemd-units\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-host\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163058    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2ff80e3-824f-4dba-aa05-e54633132373-konnectivity-ca\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163078    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-socket-dir-parent\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163117    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-sysconfig\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163126    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b0060e8e-2124-4e14-beef-9cdd53f410a1-hosts-file\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.163318 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163174    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-k8s-cni-cncf-io\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.162846    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-systemd-units\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163233    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163257    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-bin\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163282    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-cnibin\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163314    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-socket-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163338    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-run-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163355    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-cnibin\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163339    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-bin\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163382    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-log-socket\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163407    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/729e6bef-49f5-453b-83cd-601759cf885d-serviceca\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163424    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163431    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-device-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163464    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-cnibin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163454    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-log-socket\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163438    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-socket-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163486    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-multus\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163530    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-cnibin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163534    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-daemon-config\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163537    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-device-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-multus\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163653    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-etc-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163680    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-netd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163703    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-env-overrides\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163724    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-etc-openvswitch\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163726    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff80e3-824f-4dba-aa05-e54633132373-agent-certs\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163786    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163807    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/729e6bef-49f5-453b-83cd-601759cf885d-serviceca\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163812    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-sys-fs\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163855    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-system-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163865    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-cni-netd\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163878    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-script-lib\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163935    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nszf\" (UniqueName: \"kubernetes.io/projected/729e6bef-49f5-453b-83cd-601759cf885d-kube-api-access-5nszf\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163963    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-tuned\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.164946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.163968    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-sys-fs\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164009    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-iptables-alerter-script\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164058    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2xd\" (UniqueName: \"kubernetes.io/projected/b0060e8e-2124-4e14-beef-9cdd53f410a1-kube-api-access-9z2xd\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164077    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-daemon-config\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164083    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164111    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-system-cni-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164128    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-sys\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.164154    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164201    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-registration-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164250    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-sys\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.164288    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:28.664225372 +0000 UTC m=+3.143373014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164157    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86d8b1e0-bfb9-46d7-a04f-774ecd752179-registration-dir\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164325    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-kubelet\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164351    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jdzr\" (UniqueName: \"kubernetes.io/projected/04790958-b52a-4e74-b3e1-9ee83cf04710-kube-api-access-6jdzr\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164376    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-os-release\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164399    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-conf-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164431    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-multus-certs\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.165695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164444    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-env-overrides\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164456    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164461    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bca0cc84-f86a-4950-ba65-0416612fbcd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164485    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-config\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164518    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-os-release\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164534    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-multus-conf-dir\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164578    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-run-multus-certs\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164597    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-script-lib\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164618    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-kubelet\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164726    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-systemd\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164736    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-iptables-alerter-script\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164760    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-run\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164790    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-system-cni-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164813    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-host-slash\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164835    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-systemd\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164838    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-bin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.166447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164870    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-run\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164877    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-os-release\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164874    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-host-var-lib-cni-bin\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164929    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-host-slash\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164941    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164953    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04790958-b52a-4e74-b3e1-9ee83cf04710-os-release\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164869    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bca0cc84-f86a-4950-ba65-0416612fbcd5-system-cni-dir\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164972    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2929769-702f-4c06-aab9-acf091e3270a-ovn-node-metrics-cert\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165000    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/729e6bef-49f5-453b-83cd-601759cf885d-host\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.164975    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165035    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-lib-modules\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165060    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5js\" (UniqueName: \"kubernetes.io/projected/5f2d4b86-b93f-4e08-bf82-dedef40715f2-kube-api-access-nv5js\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165069    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/729e6bef-49f5-453b-83cd-601759cf885d-host\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165082    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0060e8e-2124-4e14-beef-9cdd53f410a1-tmp-dir\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165112    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-cni-binary-copy\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165150    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-slash\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f2d4b86-b93f-4e08-bf82-dedef40715f2-lib-modules\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165224    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2929769-702f-4c06-aab9-acf091e3270a-ovnkube-config\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2929769-702f-4c06-aab9-acf091e3270a-host-slash\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165580    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0060e8e-2124-4e14-beef-9cdd53f410a1-tmp-dir\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.165851    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04790958-b52a-4e74-b3e1-9ee83cf04710-cni-binary-copy\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.166546    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-tmp\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.167483    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2ff80e3-824f-4dba-aa05-e54633132373-agent-certs\") pod \"konnectivity-agent-v6njc\" (UID: \"d2ff80e3-824f-4dba-aa05-e54633132373\") " pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.167661    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5f2d4b86-b93f-4e08-bf82-dedef40715f2-etc-tuned\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.167826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.167776    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2929769-702f-4c06-aab9-acf091e3270a-ovn-node-metrics-cert\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.172441 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.172419    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:28.172441 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.172439    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:28.172613 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.172454    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:28.172613 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.172512    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:28.672500044 +0000 UTC m=+3.151647666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:28.174872 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.174846    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkl2\" (UniqueName: \"kubernetes.io/projected/a2929769-702f-4c06-aab9-acf091e3270a-kube-api-access-zjkl2\") pod \"ovnkube-node-5jf8m\" (UID: \"a2929769-702f-4c06-aab9-acf091e3270a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.178345 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.178149    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jdzr\" (UniqueName: \"kubernetes.io/projected/04790958-b52a-4e74-b3e1-9ee83cf04710-kube-api-access-6jdzr\") pod \"multus-fc6dv\" (UID: \"04790958-b52a-4e74-b3e1-9ee83cf04710\") " pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.178345 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.178295    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5js\" (UniqueName: \"kubernetes.io/projected/5f2d4b86-b93f-4e08-bf82-dedef40715f2-kube-api-access-nv5js\") pod \"tuned-65nlr\" (UID: \"5f2d4b86-b93f-4e08-bf82-dedef40715f2\") " pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.178516 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.178395    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8t4m\" (UniqueName: \"kubernetes.io/projected/97106aed-260f-4660-9104-3cc42b40f829-kube-api-access-x8t4m\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.178600 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.178576    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj2kc\" (UniqueName: \"kubernetes.io/projected/86d8b1e0-bfb9-46d7-a04f-774ecd752179-kube-api-access-jj2kc\") pod \"aws-ebs-csi-driver-node-xrx84\" (UID: \"86d8b1e0-bfb9-46d7-a04f-774ecd752179\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.179015 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.178992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlnhx\" (UniqueName: \"kubernetes.io/projected/bca0cc84-f86a-4950-ba65-0416612fbcd5-kube-api-access-wlnhx\") pod \"multus-additional-cni-plugins-c8t7g\" (UID: \"bca0cc84-f86a-4950-ba65-0416612fbcd5\") " pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.179312 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.179293    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nszf\" (UniqueName: \"kubernetes.io/projected/729e6bef-49f5-453b-83cd-601759cf885d-kube-api-access-5nszf\") pod \"node-ca-7h4nj\" (UID: \"729e6bef-49f5-453b-83cd-601759cf885d\") " pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.179616 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.179600    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbg2\" (UniqueName: \"kubernetes.io/projected/fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5-kube-api-access-jqbg2\") pod \"iptables-alerter-rt4fj\" (UID: \"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5\") " pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.180034 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.180017    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2xd\" (UniqueName: \"kubernetes.io/projected/b0060e8e-2124-4e14-beef-9cdd53f410a1-kube-api-access-9z2xd\") pod \"node-resolver-f7brn\" (UID: \"b0060e8e-2124-4e14-beef-9cdd53f410a1\") " pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.341643 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.341561    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84"
May 26 19:40:28.350364 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.350333    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fc6dv"
May 26 19:40:28.359184 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.359135    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:28.364800 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.364775    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:28.371615 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.371588    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7h4nj"
May 26 19:40:28.378368 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.378347    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-65nlr"
May 26 19:40:28.385988 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.385958    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c8t7g"
May 26 19:40:28.394551 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.394525    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rt4fj"
May 26 19:40:28.399206 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.399183    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f7brn"
May 26 19:40:28.669586 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.669518    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:28.669713 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.669641    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:28.669713 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.669695    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:29.669681064 +0000 UTC m=+4.148828685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:28.699572 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.699350    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ff80e3_824f_4dba_aa05_e54633132373.slice/crio-48d12ff7a64a1163d981e189e9b5f7ead9c25c6f512ff1fcb543869593d98598 WatchSource:0}: Error finding container 48d12ff7a64a1163d981e189e9b5f7ead9c25c6f512ff1fcb543869593d98598: Status 404 returned error can't find the container with id 48d12ff7a64a1163d981e189e9b5f7ead9c25c6f512ff1fcb543869593d98598
May 26 19:40:28.700236 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.700175    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2929769_702f_4c06_aab9_acf091e3270a.slice/crio-246920b83749687a544dbe1117c51bf625f54f93ae446cc3feefd31afc25442b WatchSource:0}: Error finding container 246920b83749687a544dbe1117c51bf625f54f93ae446cc3feefd31afc25442b: Status 404 returned error can't find the container with id 246920b83749687a544dbe1117c51bf625f54f93ae446cc3feefd31afc25442b
May 26 19:40:28.702935 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.702895    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2d4b86_b93f_4e08_bf82_dedef40715f2.slice/crio-327cc0631a9946ce754de0e2d77ac5a1ba3f5e08e7cdfe003d43e75916eed387 WatchSource:0}: Error finding container 327cc0631a9946ce754de0e2d77ac5a1ba3f5e08e7cdfe003d43e75916eed387: Status 404 returned error can't find the container with id 327cc0631a9946ce754de0e2d77ac5a1ba3f5e08e7cdfe003d43e75916eed387
May 26 19:40:28.704140 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.704112    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcea8530_b6a2_4503_bdf3_1d5d70fc3eb5.slice/crio-3f6e966ab675e54e5fdfb955feddd70b205a336ba732cdffb04db792e7625ea6 WatchSource:0}: Error finding container 3f6e966ab675e54e5fdfb955feddd70b205a336ba732cdffb04db792e7625ea6: Status 404 returned error can't find the container with id 3f6e966ab675e54e5fdfb955feddd70b205a336ba732cdffb04db792e7625ea6
May 26 19:40:28.705220 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.705157    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d8b1e0_bfb9_46d7_a04f_774ecd752179.slice/crio-80a47a6b32ec1a67b0386356c32fa4842931794ae813a388ebde438f3ce8baef WatchSource:0}: Error finding container 80a47a6b32ec1a67b0386356c32fa4842931794ae813a388ebde438f3ce8baef: Status 404 returned error can't find the container with id 80a47a6b32ec1a67b0386356c32fa4842931794ae813a388ebde438f3ce8baef
May 26 19:40:28.708306 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.706723    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0060e8e_2124_4e14_beef_9cdd53f410a1.slice/crio-63117d2cbb522ac70506a014baee3227929de9391eed86d0b3c8b2a49ca928c3 WatchSource:0}: Error finding container 63117d2cbb522ac70506a014baee3227929de9391eed86d0b3c8b2a49ca928c3: Status 404 returned error can't find the container with id 63117d2cbb522ac70506a014baee3227929de9391eed86d0b3c8b2a49ca928c3
May 26 19:40:28.708306 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.707307    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04790958_b52a_4e74_b3e1_9ee83cf04710.slice/crio-e94a7b60b0069ca4c7fc3c328418d20eccb06198c182c287166a953ef2aba67f WatchSource:0}: Error finding container e94a7b60b0069ca4c7fc3c328418d20eccb06198c182c287166a953ef2aba67f: Status 404 returned error can't find the container with id e94a7b60b0069ca4c7fc3c328418d20eccb06198c182c287166a953ef2aba67f
May 26 19:40:28.712587 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:40:28.712513    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729e6bef_49f5_453b_83cd_601759cf885d.slice/crio-93ed68555e8d61c6d264a1ca819a6bc9668ef989706f464b7307cb9f3cdef9ce WatchSource:0}: Error finding container 93ed68555e8d61c6d264a1ca819a6bc9668ef989706f464b7307cb9f3cdef9ce: Status 404 returned error can't find the container with id 93ed68555e8d61c6d264a1ca819a6bc9668ef989706f464b7307cb9f3cdef9ce
May 26 19:40:28.765064 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.765041    2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:28.770183 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:28.770159    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:28.770336 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.770320    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:28.770372 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.770342    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:28.770372 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.770353    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:28.770439 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:28.770407    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:29.7703855 +0000 UTC m=+4.249533122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:29.094981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.094938    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:35:27 +0000 UTC" deadline="2028-02-29 20:56:58.732247126 +0000 UTC"
May 26 19:40:29.094981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.094976    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15457h16m29.637274209s"
May 26 19:40:29.139170 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.139097    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-65nlr" event={"ID":"5f2d4b86-b93f-4e08-bf82-dedef40715f2","Type":"ContainerStarted","Data":"327cc0631a9946ce754de0e2d77ac5a1ba3f5e08e7cdfe003d43e75916eed387"}
May 26 19:40:29.140777 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.140738    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"246920b83749687a544dbe1117c51bf625f54f93ae446cc3feefd31afc25442b"}
May 26 19:40:29.143015 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.142983    2561 generic.go:358] "Generic (PLEG): container finished" podID="dd6d1db0798aad8547007cf11dfd824b" containerID="5465b97c70cccb05d2d27c7cb509a3b4ba09887963b8c3d6857977c391c2d51e" exitCode=0
May 26 19:40:29.143165 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.143057    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal" event={"ID":"dd6d1db0798aad8547007cf11dfd824b","Type":"ContainerDied","Data":"5465b97c70cccb05d2d27c7cb509a3b4ba09887963b8c3d6857977c391c2d51e"}
May 26 19:40:29.145474 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.145448    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerStarted","Data":"32dae9179fb8381f89539bf608d4cf982e5649b75853b32e45ccd63fe34ade51"}
May 26 19:40:29.146666 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.146639    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7h4nj" event={"ID":"729e6bef-49f5-453b-83cd-601759cf885d","Type":"ContainerStarted","Data":"93ed68555e8d61c6d264a1ca819a6bc9668ef989706f464b7307cb9f3cdef9ce"}
May 26 19:40:29.149421 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.149318    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f7brn" event={"ID":"b0060e8e-2124-4e14-beef-9cdd53f410a1","Type":"ContainerStarted","Data":"63117d2cbb522ac70506a014baee3227929de9391eed86d0b3c8b2a49ca928c3"}
May 26 19:40:29.151237 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.151199    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rt4fj" event={"ID":"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5","Type":"ContainerStarted","Data":"3f6e966ab675e54e5fdfb955feddd70b205a336ba732cdffb04db792e7625ea6"}
May 26 19:40:29.152314 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.152282    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v6njc" event={"ID":"d2ff80e3-824f-4dba-aa05-e54633132373","Type":"ContainerStarted","Data":"48d12ff7a64a1163d981e189e9b5f7ead9c25c6f512ff1fcb543869593d98598"}
May 26 19:40:29.157304 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.156865    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal" event={"ID":"c66f86e1ffcc081e15ecdd4acdb9df2b","Type":"ContainerStarted","Data":"c1beeaf07e7fc06f171d5acb273a49230380f51e65df0593058e09e31dfc8b62"}
May 26 19:40:29.161755 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.161167    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84" event={"ID":"86d8b1e0-bfb9-46d7-a04f-774ecd752179","Type":"ContainerStarted","Data":"80a47a6b32ec1a67b0386356c32fa4842931794ae813a388ebde438f3ce8baef"}
May 26 19:40:29.166860 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.166833    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fc6dv" event={"ID":"04790958-b52a-4e74-b3e1-9ee83cf04710","Type":"ContainerStarted","Data":"e94a7b60b0069ca4c7fc3c328418d20eccb06198c182c287166a953ef2aba67f"}
May 26 19:40:29.174811 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.174749    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-200.ec2.internal" podStartSLOduration=2.174733057 podStartE2EDuration="2.174733057s" podCreationTimestamp="2026-05-26 19:40:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:40:29.174543174 +0000 UTC m=+3.653690818" watchObservedRunningTime="2026-05-26 19:40:29.174733057 +0000 UTC m=+3.653880703"
May 26 19:40:29.678887 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.678216    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:29.678887 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.678412    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:29.678887 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.678477    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:31.67845799 +0000 UTC m=+6.157605673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:29.779749 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:29.779708    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:29.780019 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.779987    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:29.780131 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.780027    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:29.780131 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.780052    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:29.780235 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:29.780152    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:31.780116369 +0000 UTC m=+6.259263992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:30.128698 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:30.128098    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:30.128698 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:30.128288    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:30.129337 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:30.128733    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:30.129337 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:30.128845    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:30.191426 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:30.191348    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal" event={"ID":"dd6d1db0798aad8547007cf11dfd824b","Type":"ContainerStarted","Data":"067ce9064d4778564d108c6b79ff9c0f410d56ea29e1dbff623924fccf0f4de2"}
May 26 19:40:30.205408 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:30.205359    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-200.ec2.internal" podStartSLOduration=3.205344649 podStartE2EDuration="3.205344649s" podCreationTimestamp="2026-05-26 19:40:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:40:30.205083222 +0000 UTC m=+4.684230865" watchObservedRunningTime="2026-05-26 19:40:30.205344649 +0000 UTC m=+4.684492292"
May 26 19:40:31.697654 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:31.697617    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:31.698119 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.697752    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:31.698119 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.697807    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:35.697791278 +0000 UTC m=+10.176938900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:31.798618 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:31.798577    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:31.798793 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.798775    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:31.798793 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.798789    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:31.798930 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.798798    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:31.798930 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:31.798851    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:35.798838106 +0000 UTC m=+10.277985727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:32.131076 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:32.130964    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:32.131242 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:32.131102    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:32.131508 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:32.131485    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:32.131655 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:32.131585    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:34.128276 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:34.128234    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:34.128738 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:34.128383    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:34.129031 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:34.128858    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:34.129031 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:34.128975    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:35.729381 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:35.729331    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:35.729962 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.729469    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:35.729962 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.729603    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:43.729538149 +0000 UTC m=+18.208685786 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:35.829974 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:35.829883    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:35.830125 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.830064    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:35.830125 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.830087    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:35.830125 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.830098    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:35.830269 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:35.830157    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:43.830141515 +0000 UTC m=+18.309289137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:36.129955 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:36.129833    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:36.130117 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:36.130003    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:36.130437 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:36.130417    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:36.130577 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:36.130526    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:38.128670 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:38.128630    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:38.129198 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:38.128775    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:38.129198 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:38.128828    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:38.129198 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:38.128929    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:39.209227 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.208714    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-65nlr" event={"ID":"5f2d4b86-b93f-4e08-bf82-dedef40715f2","Type":"ContainerStarted","Data":"9d865108f414357d94d3650f76f6e2521f5717b6c6ad8c340723c1dfe57d6d17"}
May 26 19:40:39.210528 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.210498    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="6ecfe31c90de43837ef941b184425aade65b6126f71c3e6e980b30cfc8528291" exitCode=0
May 26 19:40:39.210655 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.210579    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"6ecfe31c90de43837ef941b184425aade65b6126f71c3e6e980b30cfc8528291"}
May 26 19:40:39.212236 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.212210    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7h4nj" event={"ID":"729e6bef-49f5-453b-83cd-601759cf885d","Type":"ContainerStarted","Data":"b9309e2681f5d365044715d3afb02ffb904233488844273754fc0449d433bc05"}
May 26 19:40:39.213819 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.213796    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f7brn" event={"ID":"b0060e8e-2124-4e14-beef-9cdd53f410a1","Type":"ContainerStarted","Data":"5b7271cf4b121ee0d7ba11da88de78fe17d74b1b6818a8e92d0dc51f61223076"}
May 26 19:40:39.216744 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.215733    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v6njc" event={"ID":"d2ff80e3-824f-4dba-aa05-e54633132373","Type":"ContainerStarted","Data":"e7604f3a62d4f70682b65e1f8cf6e55816bda7696135b38759bcf02c93877c9f"}
May 26 19:40:39.218122 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.218098    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84" event={"ID":"86d8b1e0-bfb9-46d7-a04f-774ecd752179","Type":"ContainerStarted","Data":"16be1e8e04e353f006e86f95ee957cb788605f0a5b1b53b74a09d866e27dcb41"}
May 26 19:40:39.223889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.223835    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-65nlr" podStartSLOduration=3.438138118 podStartE2EDuration="13.223819546s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.704786574 +0000 UTC m=+3.183934213" lastFinishedPulling="2026-05-26 19:40:38.490468004 +0000 UTC m=+12.969615641" observedRunningTime="2026-05-26 19:40:39.223075374 +0000 UTC m=+13.702223019" watchObservedRunningTime="2026-05-26 19:40:39.223819546 +0000 UTC m=+13.702967189"
May 26 19:40:39.237772 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.237717    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-f7brn" podStartSLOduration=3.5181951590000002 podStartE2EDuration="13.237700258s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.709832637 +0000 UTC m=+3.188980274" lastFinishedPulling="2026-05-26 19:40:38.429337741 +0000 UTC m=+12.908485373" observedRunningTime="2026-05-26 19:40:39.236985976 +0000 UTC m=+13.716133621" watchObservedRunningTime="2026-05-26 19:40:39.237700258 +0000 UTC m=+13.716847905"
May 26 19:40:39.253797 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.253737    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v6njc" podStartSLOduration=3.531106397 podStartE2EDuration="13.253721808s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.701883036 +0000 UTC m=+3.181030678" lastFinishedPulling="2026-05-26 19:40:38.424498468 +0000 UTC m=+12.903646089" observedRunningTime="2026-05-26 19:40:39.253064779 +0000 UTC m=+13.732212422" watchObservedRunningTime="2026-05-26 19:40:39.253721808 +0000 UTC m=+13.732869453"
May 26 19:40:39.272548 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.272486    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7h4nj" podStartSLOduration=3.5576205610000002 podStartE2EDuration="13.27246466s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.714495103 +0000 UTC m=+3.193642737" lastFinishedPulling="2026-05-26 19:40:38.429339199 +0000 UTC m=+12.908486836" observedRunningTime="2026-05-26 19:40:39.271600212 +0000 UTC m=+13.750747856" watchObservedRunningTime="2026-05-26 19:40:39.27246466 +0000 UTC m=+13.751612304"
May 26 19:40:39.599076 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.599048    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kfqbk"]
May 26 19:40:39.601003 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.600969    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.601119 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:39.601052    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:39.660507 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.660477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.660661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.660540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-dbus\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.660661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.660604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-kubelet-config\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.701741 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.701713    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 19:40:39.761026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.760906    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.761026 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.761000    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-dbus\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.761224 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.761027    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-kubelet-config\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.761224 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:39.761046    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:39.761224 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:39.761117    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:40:40.261096554 +0000 UTC m=+14.740244182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:39.761224 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.761118    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-kubelet-config\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:39.761434 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:39.761346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-dbus\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:40.113062 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.112939    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:40:39.701736734Z","UUID":"bef742ff-ba5b-41d8-88c4-9a4fd7d25bbb","Handler":null,"Name":"","Endpoint":""}
May 26 19:40:40.114943 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.114898    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 19:40:40.115077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.114953    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 19:40:40.129502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.129061    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:40.129502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.129080    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:40.129502 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:40.129211    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:40.129502 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:40.129461    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:40.223458 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.223422    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84" event={"ID":"86d8b1e0-bfb9-46d7-a04f-774ecd752179","Type":"ContainerStarted","Data":"91222109746a0ff35957e5dd5aa02e80e8accb6c5dc690a1af66601db714fe2c"}
May 26 19:40:40.226064 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.225439    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rt4fj" event={"ID":"fcea8530-b6a2-4503-bdf3-1d5d70fc3eb5","Type":"ContainerStarted","Data":"42964cebc8edfa025e947edf5cedfd007ef0e0d531bf46db3e3d7184cc5f189f"}
May 26 19:40:40.242758 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.242704    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rt4fj" podStartSLOduration=4.491222069 podStartE2EDuration="14.242687607s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.706745272 +0000 UTC m=+3.185892908" lastFinishedPulling="2026-05-26 19:40:38.458210817 +0000 UTC m=+12.937358446" observedRunningTime="2026-05-26 19:40:40.241976964 +0000 UTC m=+14.721124611" watchObservedRunningTime="2026-05-26 19:40:40.242687607 +0000 UTC m=+14.721835251"
May 26 19:40:40.266592 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:40.266552    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:40.266788 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:40.266660    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:40.266788 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:40.266716    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:40:41.266699216 +0000 UTC m=+15.745846843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:41.128593 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:41.128554    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:41.128746 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:41.128679    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:41.274408 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:41.274370    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:41.274930 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:41.274522    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:41.274930 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:41.274579    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:40:43.274566206 +0000 UTC m=+17.753713828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:42.127792 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:42.127749    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:42.127984 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:42.127773    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:42.127984 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:42.127930    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:42.128137 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:42.127992    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:43.019856 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.019673    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:43.020486 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.020460    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:43.128407 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.128377    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:43.128604 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.128505    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:43.289890 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.289770    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:43.289890 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.289885    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:43.290113 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.289968    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:40:47.289949724 +0000 UTC m=+21.769097347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:43.794188 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.794153    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:43.794383 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.794309    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:43.794443 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.794394    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:59.794373082 +0000 UTC m=+34.273520705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:43.895580 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:43.895537    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:43.895754 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.895673    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:43.895754 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.895695    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:43.895754 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.895708    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:43.895891 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:43.895767    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:59.895754222 +0000 UTC m=+34.374901844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:44.128353 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:44.128269    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:44.128801 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:44.128417    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:44.128801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:44.128465    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:44.128801 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:44.128587    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:45.128526 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:45.128486    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:45.128960 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:45.128612    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:45.895423 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:45.895384    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:45.895621 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:45.895519    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 19:40:45.896088 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:45.896065    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v6njc"
May 26 19:40:46.128784 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:46.128746    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:46.129390 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:46.128813    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:46.129514 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:46.129422    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:46.129514 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:46.129483    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:47.127895 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:47.127855    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:47.128064 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:47.128007    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:47.320266 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:47.320219    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:47.320679 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:47.320365    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:47.320679 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:47.320441    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:40:55.320425836 +0000 UTC m=+29.799573467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:48.128132 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:48.128055    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:48.128399 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:48.128055    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:48.128399 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:48.128199    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:48.128399 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:48.128279    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:49.128346 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:49.128311    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:49.128959 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:49.128440    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:50.128384 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:50.128340    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:50.128384 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:50.128385    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:50.128882 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:50.128495    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:50.128882 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:50.128592    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:51.128572 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.128398    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:51.129123 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:51.128656    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:51.247383 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.247340    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="154564720e84da0a744c6082e346cff9238fdb9e3c79d6663ef7bb589870f31b" exitCode=0
May 26 19:40:51.247535 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.247408    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"154564720e84da0a744c6082e346cff9238fdb9e3c79d6663ef7bb589870f31b"}
May 26 19:40:51.249589 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.249559    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84" event={"ID":"86d8b1e0-bfb9-46d7-a04f-774ecd752179","Type":"ContainerStarted","Data":"152ed9fff72b3cb4fc51a662ab396c195bb5b7371baca9bdb5457dcc0b3d561b"}
May 26 19:40:51.250797 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.250772    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fc6dv" event={"ID":"04790958-b52a-4e74-b3e1-9ee83cf04710","Type":"ContainerStarted","Data":"6555554a8b475a6fad40743da0d371605882c90c7671a92b86bbc5ab26148d33"}
May 26 19:40:51.253373 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253351    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"c54e3bbd03da20b2c44d4b70fe090ebd8de2b5aeed17d05787fd8c0f16ed47fa"}
May 26 19:40:51.253459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253380    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"7701a8b0a399eaaadfa2019beb1ccda300db563de9be6231c2c9e39d70748c0d"}
May 26 19:40:51.253459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253393    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"ba8e2d6d0dbeac22860c4978f082c9646324ceaa3b05d2a663394bbdb146b90d"}
May 26 19:40:51.253459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253407    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"1f0a395445ece5dd73dd7e9793273770fd3d2ba2e1a62e6128102bd9ba4cf132"}
May 26 19:40:51.253459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253419    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"35a3596521edcd2841db25c5ae7cb5b3a3859cfe463f67f55113ed82bf734e47"}
May 26 19:40:51.253459 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.253432    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"c45ca14122547cf0adb8d3bdbc2e8459fd9737393202b170b4b2b65e1425f628"}
May 26 19:40:51.284978 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.284898    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrx84" podStartSLOduration=3.396793477 podStartE2EDuration="25.284884335s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.708253501 +0000 UTC m=+3.187401136" lastFinishedPulling="2026-05-26 19:40:50.596344359 +0000 UTC m=+25.075491994" observedRunningTime="2026-05-26 19:40:51.284386415 +0000 UTC m=+25.763534060" watchObservedRunningTime="2026-05-26 19:40:51.284884335 +0000 UTC m=+25.764031979"
May 26 19:40:51.301308 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:51.301256    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-fc6dv" podStartSLOduration=3.6358290330000003 podStartE2EDuration="25.30123899s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.709853103 +0000 UTC m=+3.189000738" lastFinishedPulling="2026-05-26 19:40:50.375263071 +0000 UTC m=+24.854410695" observedRunningTime="2026-05-26 19:40:51.300688483 +0000 UTC m=+25.779836128" watchObservedRunningTime="2026-05-26 19:40:51.30123899 +0000 UTC m=+25.780386633"
May 26 19:40:52.131341 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:52.131307    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:52.131814 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:52.131309    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:52.131814 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:52.131421    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:52.131814 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:52.131502    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:53.128590 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:53.128558    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:53.128764 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:53.128660    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:53.262659 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:53.262624    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="da9f80c78283fcfe00c1b1e91a163f9a01758e81378c9b13c8e1139e40da433f" exitCode=0
May 26 19:40:53.263014 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:53.262683    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"da9f80c78283fcfe00c1b1e91a163f9a01758e81378c9b13c8e1139e40da433f"}
May 26 19:40:54.128099 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:54.128073    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:54.128099 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:54.128093    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:54.128240 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:54.128189    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:54.128290 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:54.128274    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:54.267150 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:54.267117    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="dc2d765c2966b774eb8703f36aa9deb56aa5972129af1fd1fc95171216f4e030" exitCode=0
May 26 19:40:54.267658 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:54.267208    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"dc2d765c2966b774eb8703f36aa9deb56aa5972129af1fd1fc95171216f4e030"}
May 26 19:40:54.270301 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:54.270276    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"94ef29e630a57db6fd4de778bb528cc3187599388348221162bd533d04736808"}
May 26 19:40:55.128603 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:55.128566    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:55.128751 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:55.128675    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:55.377031 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:55.376788    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:55.377374 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:55.376979    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:40:55.377374 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:55.377168    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret podName:4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:11.377145836 +0000 UTC m=+45.856293460 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret") pod "global-pull-secret-syncer-kfqbk" (UID: "4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c") : object "kube-system"/"original-pull-secret" not registered
May 26 19:40:56.129269 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.129238    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:56.129407 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:56.129324    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:56.129444 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.129411    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:56.129530 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:56.129508    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:56.276683 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.276638    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" event={"ID":"a2929769-702f-4c06-aab9-acf091e3270a","Type":"ContainerStarted","Data":"b18de2a681b5459be7e268046962e65f7dc9f622575712a033113609e6d1c5c2"}
May 26 19:40:56.276993 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.276971    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:56.277038 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.277007    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:56.293526 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.293500    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:56.303485 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:56.303438    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m" podStartSLOduration=8.632402232 podStartE2EDuration="30.303426617s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.703338119 +0000 UTC m=+3.182485740" lastFinishedPulling="2026-05-26 19:40:50.374362491 +0000 UTC m=+24.853510125" observedRunningTime="2026-05-26 19:40:56.303017312 +0000 UTC m=+30.782164956" watchObservedRunningTime="2026-05-26 19:40:56.303426617 +0000 UTC m=+30.782574260"
May 26 19:40:57.127747 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.127715    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:57.128236 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:57.127827    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:57.279320 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.279280    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:57.295704 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.295674    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:40:57.312804 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.312767    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kvrzg"]
May 26 19:40:57.313002 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.312949    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:57.313113 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:57.313083    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:57.315906 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.315835    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-854dh"]
May 26 19:40:57.316074 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.316060    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:57.316201 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:57.316182    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:57.316520 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.316497    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfqbk"]
May 26 19:40:57.316647 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:57.316580    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:57.316694 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:57.316672    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:59.128359 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:59.128313    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:59.128359 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:59.128362    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:59.128860 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.128489    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:40:59.128860 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:59.128552    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:40:59.128860 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.128549    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:40:59.128860 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.128618    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:40:59.810198 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:59.810141    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:40:59.810436 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.810307    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:59.810436 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.810374    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:31.810354192 +0000 UTC m=+66.289501817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:59.911249 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:40:59.911207    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:40:59.911418 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.911399    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:59.911469 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.911425    2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:59.911469 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.911438    2561 projected.go:194] Error preparing data for projected volume kube-api-access-95jlg for pod openshift-network-diagnostics/network-check-target-kvrzg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:59.911570 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:40:59.911501    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg podName:ec1f9b1b-7131-4aca-b877-13e671c7a013 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:31.911482451 +0000 UTC m=+66.390630092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-95jlg" (UniqueName: "kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg") pod "network-check-target-kvrzg" (UID: "ec1f9b1b-7131-4aca-b877-13e671c7a013") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:41:01.127711 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:01.127666    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:01.127711 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:01.127712    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:01.128254 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:01.127794    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:41:01.128254 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:01.127886    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:41:01.128254 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:01.127972    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:41:01.128254 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:01.128065    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:41:03.128034 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:03.127846    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:03.128397 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:03.127874    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:03.128397 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:03.128109    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kfqbk" podUID="4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c"
May 26 19:41:03.128397 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:03.127903    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:41:03.128397 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:03.128183    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kvrzg" podUID="ec1f9b1b-7131-4aca-b877-13e671c7a013"
May 26 19:41:03.128397 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:03.128250    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-854dh" podUID="97106aed-260f-4660-9104-3cc42b40f829"
May 26 19:41:04.293964 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.293900    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="525836cd9c8f068e45b1b36c18f566b24c046920891181747b9c9e68408680ac" exitCode=0
May 26 19:41:04.294418 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.293977    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"525836cd9c8f068e45b1b36c18f566b24c046920891181747b9c9e68408680ac"}
May 26 19:41:04.363896 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.363872    2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-200.ec2.internal" event="NodeReady"
May 26 19:41:04.364032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.364017    2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 19:41:04.401802 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.401772    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"]
May 26 19:41:04.426871 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.426845    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"]
May 26 19:41:04.427084 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.427061    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.429679 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.429632    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 19:41:04.430851 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.430272    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 19:41:04.430851 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.430481    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 19:41:04.430851 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.430687    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 19:41:04.457195 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.457154    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69cf8fbf57-glhzf"]
May 26 19:41:04.457351 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.457300    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.460595 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.460554    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 19:41:04.460595 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.460586    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 19:41:04.460808 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.460677    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 19:41:04.461013 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.460988    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 19:41:04.479346 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.479321    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"]
May 26 19:41:04.479479 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.479456    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.482027 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.482004    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 19:41:04.482302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.482288    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 19:41:04.482386 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.482301    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 19:41:04.482386 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.482316    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-42p9z\""
May 26 19:41:04.495495 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.495468    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lcmsw"]
May 26 19:41:04.495630 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.495612    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.498553 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.498524    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hxwg5\""
May 26 19:41:04.498667 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.498613    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 19:41:04.504211 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.504185    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 19:41:04.509609 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509586    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"]
May 26 19:41:04.509609 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509611    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"]
May 26 19:41:04.509795 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509622    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"]
May 26 19:41:04.509795 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509630    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69cf8fbf57-glhzf"]
May 26 19:41:04.509795 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509640    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6fd"]
May 26 19:41:04.509795 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.509761    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.512872 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.512850    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 19:41:04.512872 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.512870    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 19:41:04.513016 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.512858    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4rbd\""
May 26 19:41:04.525826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.525798    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lcmsw"]
May 26 19:41:04.525826 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.525824    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6fd"]
May 26 19:41:04.526032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.525964    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.528519 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.528503    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 19:41:04.528632 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.528612    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 19:41:04.528732 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.528719    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 19:41:04.528775 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.528735    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nxp95\""
May 26 19:41:04.545387 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545304    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545387 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545387 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545383    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qdd\" (UniqueName: \"kubernetes.io/projected/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-kube-api-access-j7qdd\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545704    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23abb884-cfb0-4a14-979d-11c600ecf6ea-tmp\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrztb\" (UniqueName: \"kubernetes.io/projected/23abb884-cfb0-4a14-979d-11c600ecf6ea-kube-api-access-zrztb\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545761    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjq8d\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23abb884-cfb0-4a14-979d-11c600ecf6ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.545954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.545868    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.646437 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646399    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.646619 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646461    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.646619 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646507    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.646619 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c8be441-9348-4e41-902a-ed09d13acf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.646619 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646567    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qdd\" (UniqueName: \"kubernetes.io/projected/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-kube-api-access-j7qdd\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.646801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-config-volume\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.646801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-tmp-dir\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.646801 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgfps\" (UniqueName: \"kubernetes.io/projected/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-kube-api-access-mgfps\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.646977 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646830    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.646977 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646901    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.646977 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.646965    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.647140 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647001    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.647140 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647042    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.647140 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.647078    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:04.647140 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.647115    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:04.647343 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647183    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.647343 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647216    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.647343 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647244    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23abb884-cfb0-4a14-979d-11c600ecf6ea-tmp\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.647465 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647357    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.647589 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23abb884-cfb0-4a14-979d-11c600ecf6ea-tmp\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647656    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647669    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647705    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrztb\" (UniqueName: \"kubernetes.io/projected/23abb884-cfb0-4a14-979d-11c600ecf6ea-kube-api-access-zrztb\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647741    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxqq\" (UniqueName: \"kubernetes.io/projected/8b228343-2f31-4961-a671-f4ed4737f117-kube-api-access-6bxqq\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.647778    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:05.147746261 +0000 UTC m=+39.626893890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647862    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjq8d\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647885    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647941    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23abb884-cfb0-4a14-979d-11c600ecf6ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647967    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.647993    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.648305 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.648030    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdktc\" (UniqueName: \"kubernetes.io/projected/9c8be441-9348-4e41-902a-ed09d13acf37-kube-api-access-zdktc\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.649223 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.649198    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.651492 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651423    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-ca\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.651492 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651435    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.651492 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651424    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.651661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651501    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.651661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651503    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.651661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651525    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.651661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.651533    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23abb884-cfb0-4a14-979d-11c600ecf6ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.654774 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.654750    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qdd\" (UniqueName: \"kubernetes.io/projected/abb6e1b5-aa91-409c-a2bc-a3107d1fd166-kube-api-access-j7qdd\") pod \"cluster-proxy-proxy-agent-8676455879-s7cmj\" (UID: \"abb6e1b5-aa91-409c-a2bc-a3107d1fd166\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.656997 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.656904    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.656997 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.656944    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrztb\" (UniqueName: \"kubernetes.io/projected/23abb884-cfb0-4a14-979d-11c600ecf6ea-kube-api-access-zrztb\") pod \"klusterlet-addon-workmgr-5b8f76888-zxtr9\" (UID: \"23abb884-cfb0-4a14-979d-11c600ecf6ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.657147 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.657080    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjq8d\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:04.741154 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.741116    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:04.749227 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749193    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c8be441-9348-4e41-902a-ed09d13acf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.749373 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749251    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-config-volume\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.749373 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749276    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-tmp-dir\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.749373 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749303    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgfps\" (UniqueName: \"kubernetes.io/projected/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-kube-api-access-mgfps\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.749373 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749363    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.749570 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749405    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxqq\" (UniqueName: \"kubernetes.io/projected/8b228343-2f31-4961-a671-f4ed4737f117-kube-api-access-6bxqq\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.749570 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749428    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.749570 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.749477    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdktc\" (UniqueName: \"kubernetes.io/projected/9c8be441-9348-4e41-902a-ed09d13acf37-kube-api-access-zdktc\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.750025 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.750000    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:04.750199 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.750076    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:05.250054892 +0000 UTC m=+39.729202517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:04.750199 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.750138    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:04.750361 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:04.750207    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:05.250189536 +0000 UTC m=+39.729337158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:04.750361 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.750283    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-tmp-dir\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.750513 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.750466    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-config-volume\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.752257 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.752224    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c8be441-9348-4e41-902a-ed09d13acf37-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.758647 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.758611    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgfps\" (UniqueName: \"kubernetes.io/projected/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-kube-api-access-mgfps\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:04.759663 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.759639    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdktc\" (UniqueName: \"kubernetes.io/projected/9c8be441-9348-4e41-902a-ed09d13acf37-kube-api-access-zdktc\") pod \"managed-serviceaccount-addon-agent-9f4d664d6-rxrr7\" (UID: \"9c8be441-9348-4e41-902a-ed09d13acf37\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.759946 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.759924    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxqq\" (UniqueName: \"kubernetes.io/projected/8b228343-2f31-4961-a671-f4ed4737f117-kube-api-access-6bxqq\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:04.775875 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.775839    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:41:04.851493 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.850943    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"
May 26 19:41:04.968905 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.968722    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"]
May 26 19:41:04.972232 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:41:04.972202    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23abb884_cfb0_4a14_979d_11c600ecf6ea.slice/crio-b7bbed7c734dba04c07e3f1af0cf34c3cd690603b46de7df5bf4ac1ab0d389c1 WatchSource:0}: Error finding container b7bbed7c734dba04c07e3f1af0cf34c3cd690603b46de7df5bf4ac1ab0d389c1: Status 404 returned error can't find the container with id b7bbed7c734dba04c07e3f1af0cf34c3cd690603b46de7df5bf4ac1ab0d389c1
May 26 19:41:04.975356 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:04.975327    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"]
May 26 19:41:04.978484 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:41:04.978450    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabb6e1b5_aa91_409c_a2bc_a3107d1fd166.slice/crio-c75a001e8e2bdfd4342ffef3ee94bfe8377dbce2a2aa444a50d6d6452f8b1f86 WatchSource:0}: Error finding container c75a001e8e2bdfd4342ffef3ee94bfe8377dbce2a2aa444a50d6d6452f8b1f86: Status 404 returned error can't find the container with id c75a001e8e2bdfd4342ffef3ee94bfe8377dbce2a2aa444a50d6d6452f8b1f86
May 26 19:41:05.004209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.004176    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7"]
May 26 19:41:05.007511 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:41:05.007483    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c8be441_9348_4e41_902a_ed09d13acf37.slice/crio-793e3130bbaf6885658a28b49acf46b651421f4aa6eab463740bf9d08cfa8d3c WatchSource:0}: Error finding container 793e3130bbaf6885658a28b49acf46b651421f4aa6eab463740bf9d08cfa8d3c: Status 404 returned error can't find the container with id 793e3130bbaf6885658a28b49acf46b651421f4aa6eab463740bf9d08cfa8d3c
May 26 19:41:05.128054 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.127954    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:05.128242 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.127963    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:05.128242 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.127976    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:41:05.131270 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131229    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:41:05.131270 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131265    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 19:41:05.131494 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131275    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dx2vm\""
May 26 19:41:05.131494 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131242    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:41:05.131494 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131243    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqg4\""
May 26 19:41:05.131494 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.131270    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:41:05.153740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.153711    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:05.153880 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.153862    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:05.153940 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.153882    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:05.153974 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.153956    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:06.153941283 +0000 UTC m=+40.633088905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:05.254535 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.254497    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:05.254740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.254567    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:05.254740 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.254663    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:05.254740 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.254683    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:05.254740 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.254732    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:06.254719199 +0000 UTC m=+40.733866820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:05.254740 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:05.254744    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:06.254738491 +0000 UTC m=+40.733886113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:05.305823 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.305785    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7" event={"ID":"9c8be441-9348-4e41-902a-ed09d13acf37","Type":"ContainerStarted","Data":"793e3130bbaf6885658a28b49acf46b651421f4aa6eab463740bf9d08cfa8d3c"}
May 26 19:41:05.306736 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.306714    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerStarted","Data":"c75a001e8e2bdfd4342ffef3ee94bfe8377dbce2a2aa444a50d6d6452f8b1f86"}
May 26 19:41:05.307829 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.307804    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9" event={"ID":"23abb884-cfb0-4a14-979d-11c600ecf6ea","Type":"ContainerStarted","Data":"b7bbed7c734dba04c07e3f1af0cf34c3cd690603b46de7df5bf4ac1ab0d389c1"}
May 26 19:41:05.310421 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.310397    2561 generic.go:358] "Generic (PLEG): container finished" podID="bca0cc84-f86a-4950-ba65-0416612fbcd5" containerID="afecdd3e789f14dd76c999fa60e6e9f3b701d550ce182ce164ed10fc2f21014f" exitCode=0
May 26 19:41:05.310519 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:05.310435    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerDied","Data":"afecdd3e789f14dd76c999fa60e6e9f3b701d550ce182ce164ed10fc2f21014f"}
May 26 19:41:06.164557 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:06.164517    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:06.164842 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.164677    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:06.164842 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.164694    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:06.164842 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.164754    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:08.16473402 +0000 UTC m=+42.643881644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:06.265325 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:06.265285    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:06.265520 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:06.265358    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:06.265520 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.265499    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:06.265695 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.265657    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:08.265605286 +0000 UTC m=+42.744752921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:06.266349 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.266304    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:06.266464 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:06.266359    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:08.266343305 +0000 UTC m=+42.745490932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:06.322275 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:06.321446    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" event={"ID":"bca0cc84-f86a-4950-ba65-0416612fbcd5","Type":"ContainerStarted","Data":"359c13d1a9f58cce38b6b2ad37f1420fe09bf456372b5e2b07614eb97bd8f3bc"}
May 26 19:41:06.344784 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:06.343436    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c8t7g" podStartSLOduration=5.676802727 podStartE2EDuration="40.343415051s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:40:28.715538025 +0000 UTC m=+3.194685646" lastFinishedPulling="2026-05-26 19:41:03.382150345 +0000 UTC m=+37.861297970" observedRunningTime="2026-05-26 19:41:06.342461545 +0000 UTC m=+40.821609190" watchObservedRunningTime="2026-05-26 19:41:06.343415051 +0000 UTC m=+40.822562697"
May 26 19:41:08.181218 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:08.181175    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:08.181644 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.181353    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:08.181644 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.181380    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:08.181644 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.181458    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:12.181436085 +0000 UTC m=+46.660583710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:08.282454 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:08.282411    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:08.282608 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:08.282490    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:08.282608 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.282588    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:08.282718 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.282666    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:12.282644071 +0000 UTC m=+46.761791714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:08.282718 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.282703    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:08.282791 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:08.282768    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:12.282751206 +0000 UTC m=+46.761898830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:11.410987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:11.409645    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:11.414533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:11.414502    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c-original-pull-secret\") pod \"global-pull-secret-syncer-kfqbk\" (UID: \"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c\") " pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:11.445618 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:11.445578    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kfqbk"
May 26 19:41:12.218129 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:12.218088    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:12.218278 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.218231    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:12.218278 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.218247    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:12.218372 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.218301    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:20.218287978 +0000 UTC m=+54.697435600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:12.318837 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:12.318795    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:12.318992 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:12.318856    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:12.318992 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.318972    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:12.318992 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.318974    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:12.319139 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.319035    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:20.319019717 +0000 UTC m=+54.798167338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:12.319139 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:12.319049    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:20.319043121 +0000 UTC m=+54.798190742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:12.727821 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:12.727777    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kfqbk"]
May 26 19:41:12.730616 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:41:12.730569    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9c95f7_61b1_4c6b_bb08_1a18fb05fe7c.slice/crio-57c5bb2adb8d23ef45435f1f8580e5e6f27e0bfea804af2907daa672f4bbc7ff WatchSource:0}: Error finding container 57c5bb2adb8d23ef45435f1f8580e5e6f27e0bfea804af2907daa672f4bbc7ff: Status 404 returned error can't find the container with id 57c5bb2adb8d23ef45435f1f8580e5e6f27e0bfea804af2907daa672f4bbc7ff
May 26 19:41:13.337516 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.337477    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerStarted","Data":"cd9c124efa8a089a2c22207e8b001bd0854f8b994a0ce35fdc0bed70dfa873ee"}
May 26 19:41:13.338695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.338671    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9" event={"ID":"23abb884-cfb0-4a14-979d-11c600ecf6ea","Type":"ContainerStarted","Data":"b102d2938778a05462b6686186d33ceaf9205450cb15143ba3f33770b8958e60"}
May 26 19:41:13.338854 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.338831    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:13.340195 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.340157    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7" event={"ID":"9c8be441-9348-4e41-902a-ed09d13acf37","Type":"ContainerStarted","Data":"991e51ce576bb530e4645f350efcca9f45eb0e4982039914c284e553d5de5f60"}
May 26 19:41:13.340777 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.340748    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9"
May 26 19:41:13.341231 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.341213    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfqbk" event={"ID":"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c","Type":"ContainerStarted","Data":"57c5bb2adb8d23ef45435f1f8580e5e6f27e0bfea804af2907daa672f4bbc7ff"}
May 26 19:41:13.359423 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:13.359389    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b8f76888-zxtr9" podStartSLOduration=17.728688119 podStartE2EDuration="25.359376799s" podCreationTimestamp="2026-05-26 19:40:48 +0000 UTC" firstStartedPulling="2026-05-26 19:41:04.9749055 +0000 UTC m=+39.454053121" lastFinishedPulling="2026-05-26 19:41:12.605594176 +0000 UTC m=+47.084741801" observedRunningTime="2026-05-26 19:41:13.358653429 +0000 UTC m=+47.837801075" watchObservedRunningTime="2026-05-26 19:41:13.359376799 +0000 UTC m=+47.838524442"
May 26 19:41:16.145280 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:16.145222    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9f4d664d6-rxrr7" podStartSLOduration=20.572180925 podStartE2EDuration="28.145206792s" podCreationTimestamp="2026-05-26 19:40:48 +0000 UTC" firstStartedPulling="2026-05-26 19:41:05.00963468 +0000 UTC m=+39.488782301" lastFinishedPulling="2026-05-26 19:41:12.582660532 +0000 UTC m=+47.061808168" observedRunningTime="2026-05-26 19:41:13.388882043 +0000 UTC m=+47.868029712" watchObservedRunningTime="2026-05-26 19:41:16.145206792 +0000 UTC m=+50.624354436"
May 26 19:41:16.349832 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:16.349790    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerStarted","Data":"14feed58b72cca4e0823c0da6a6cc44e73182267558f94d4368585e2fa125e19"}
May 26 19:41:16.350031 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:16.349839    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerStarted","Data":"04f0fa38ce2c4eae855fbb7dd32fc1e2942b28e6b15fad3db163da8e0674d108"}
May 26 19:41:16.367347 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:16.367301    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" podStartSLOduration=18.057978634 podStartE2EDuration="28.367288042s" podCreationTimestamp="2026-05-26 19:40:48 +0000 UTC" firstStartedPulling="2026-05-26 19:41:04.980319908 +0000 UTC m=+39.459467529" lastFinishedPulling="2026-05-26 19:41:15.289629297 +0000 UTC m=+49.768776937" observedRunningTime="2026-05-26 19:41:16.366533164 +0000 UTC m=+50.845680809" watchObservedRunningTime="2026-05-26 19:41:16.367288042 +0000 UTC m=+50.846435718"
May 26 19:41:19.360659 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:19.360617    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kfqbk" event={"ID":"4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c","Type":"ContainerStarted","Data":"b544bea148258fb430f5baf8166fb7d4be5038ea88d9afe4fb68fbc465bb7cfd"}
May 26 19:41:19.376301 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:19.376252    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kfqbk" podStartSLOduration=34.897118865 podStartE2EDuration="40.376236215s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:41:12.73271039 +0000 UTC m=+47.211858020" lastFinishedPulling="2026-05-26 19:41:18.211827747 +0000 UTC m=+52.690975370" observedRunningTime="2026-05-26 19:41:19.375894298 +0000 UTC m=+53.855041941" watchObservedRunningTime="2026-05-26 19:41:19.376236215 +0000 UTC m=+53.855383860"
May 26 19:41:20.283753 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:20.283711    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:20.283973 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.283867    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:20.283973 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.283884    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:20.284067 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.283974    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:36.283956625 +0000 UTC m=+70.763104250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:20.384507 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:20.384457    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:20.384995 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:20.384597    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:20.384995 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.384635    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:20.384995 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.384690    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:20.384995 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.384708    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:36.384688327 +0000 UTC m=+70.863835952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:20.384995 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:20.384733    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:36.384722415 +0000 UTC m=+70.863870042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:29.293768 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:29.293739    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5jf8m"
May 26 19:41:31.870701 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.870640    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:41:31.873427 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.873406    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:41:31.881711 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:31.881684    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:41:31.881833 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:31.881753    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs podName:97106aed-260f-4660-9104-3cc42b40f829 nodeName:}" failed. No retries permitted until 2026-05-26 19:42:35.881734934 +0000 UTC m=+130.360882556 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs") pod "network-metrics-daemon-854dh" (UID: "97106aed-260f-4660-9104-3cc42b40f829") : secret "metrics-daemon-secret" not found
May 26 19:41:31.971648 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.971597    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:31.974468 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.974445    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:41:31.985205 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.985167    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:41:31.996223 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:31.996196    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jlg\" (UniqueName: \"kubernetes.io/projected/ec1f9b1b-7131-4aca-b877-13e671c7a013-kube-api-access-95jlg\") pod \"network-check-target-kvrzg\" (UID: \"ec1f9b1b-7131-4aca-b877-13e671c7a013\") " pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:32.142750 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:32.142668    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqg4\""
May 26 19:41:32.149985 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:32.149961    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:32.276365 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:32.276334    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kvrzg"]
May 26 19:41:32.279764 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:41:32.279732    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1f9b1b_7131_4aca_b877_13e671c7a013.slice/crio-56277fc44e42d773679820b1f5476fc2bf9abd06ff067ce1ac31730d80ffe887 WatchSource:0}: Error finding container 56277fc44e42d773679820b1f5476fc2bf9abd06ff067ce1ac31730d80ffe887: Status 404 returned error can't find the container with id 56277fc44e42d773679820b1f5476fc2bf9abd06ff067ce1ac31730d80ffe887
May 26 19:41:32.395796 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:32.395707    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kvrzg" event={"ID":"ec1f9b1b-7131-4aca-b877-13e671c7a013","Type":"ContainerStarted","Data":"56277fc44e42d773679820b1f5476fc2bf9abd06ff067ce1ac31730d80ffe887"}
May 26 19:41:36.309990 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:36.309851    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:41:36.310413 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.310014    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:41:36.310413 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.310030    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:41:36.310413 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.310091    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:42:08.310072249 +0000 UTC m=+102.789219876 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:41:36.411206 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:36.411175    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:41:36.411364 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:36.411220    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:41:36.411364 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.411321    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:36.411364 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.411324    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:36.411457 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.411377    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:42:08.411361216 +0000 UTC m=+102.890508856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:41:36.411457 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:41:36.411390    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:42:08.411384192 +0000 UTC m=+102.890531814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:41:37.410984 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:37.410948    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kvrzg" event={"ID":"ec1f9b1b-7131-4aca-b877-13e671c7a013","Type":"ContainerStarted","Data":"a43bcc98498461452b82e99458ed744bb3502d398c84d9a035d7b3650b58bae8"}
May 26 19:41:37.411410 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:37.411074    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:41:37.428015 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:41:37.427965    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kvrzg" podStartSLOduration=67.287317114 podStartE2EDuration="1m11.427950694s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:41:32.281780916 +0000 UTC m=+66.760928538" lastFinishedPulling="2026-05-26 19:41:36.422414496 +0000 UTC m=+70.901562118" observedRunningTime="2026-05-26 19:41:37.427778571 +0000 UTC m=+71.906926216" watchObservedRunningTime="2026-05-26 19:41:37.427950694 +0000 UTC m=+71.907098339"
May 26 19:42:08.355236 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:08.355181    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") pod \"image-registry-69cf8fbf57-glhzf\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") " pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:42:08.355689 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.355337    2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:08.355689 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.355358    2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69cf8fbf57-glhzf: secret "image-registry-tls" not found
May 26 19:42:08.355689 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.355432    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls podName:5a7345c1-e9d2-402d-b489-7c09c394a636 nodeName:}" failed. No retries permitted until 2026-05-26 19:43:12.355415292 +0000 UTC m=+166.834562913 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls") pod "image-registry-69cf8fbf57-glhzf" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636") : secret "image-registry-tls" not found
May 26 19:42:08.415878 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:08.415846    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kvrzg"
May 26 19:42:08.456230 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:08.456188    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:42:08.456393 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:08.456306    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:42:08.456393 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.456379    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:42:08.456468 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.456402    2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:42:08.456468 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.456459    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls podName:1a9c632b-2ab2-4084-9d38-b98c5ac60f72 nodeName:}" failed. No retries permitted until 2026-05-26 19:43:12.456442634 +0000 UTC m=+166.935590257 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls") pod "dns-default-lcmsw" (UID: "1a9c632b-2ab2-4084-9d38-b98c5ac60f72") : secret "dns-default-metrics-tls" not found
May 26 19:42:08.456536 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:42:08.456476    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert podName:8b228343-2f31-4961-a671-f4ed4737f117 nodeName:}" failed. No retries permitted until 2026-05-26 19:43:12.45646899 +0000 UTC m=+166.935616612 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert") pod "ingress-canary-2m6fd" (UID: "8b228343-2f31-4961-a671-f4ed4737f117") : secret "canary-serving-cert" not found
May 26 19:42:25.613584 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:25.613554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f7brn_b0060e8e-2124-4e14-beef-9cdd53f410a1/dns-node-resolver/0.log"
May 26 19:42:26.412671 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:26.412643    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7h4nj_729e6bef-49f5-453b-83cd-601759cf885d/node-ca/0.log"
May 26 19:42:35.972891 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:35.972843    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:42:35.975255 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:35.975234    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97106aed-260f-4660-9104-3cc42b40f829-metrics-certs\") pod \"network-metrics-daemon-854dh\" (UID: \"97106aed-260f-4660-9104-3cc42b40f829\") " pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:42:36.053535 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:36.053500    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dx2vm\""
May 26 19:42:36.061544 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:36.061522    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-854dh"
May 26 19:42:36.192091 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:36.192049    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-854dh"]
May 26 19:42:36.195336 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:42:36.195307    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97106aed_260f_4660_9104_3cc42b40f829.slice/crio-65b689baccae75920c5e7d78443ff83582d2c7bd231b58e13262c01a9a8ed6ef WatchSource:0}: Error finding container 65b689baccae75920c5e7d78443ff83582d2c7bd231b58e13262c01a9a8ed6ef: Status 404 returned error can't find the container with id 65b689baccae75920c5e7d78443ff83582d2c7bd231b58e13262c01a9a8ed6ef
May 26 19:42:36.556907 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:36.556858    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-854dh" event={"ID":"97106aed-260f-4660-9104-3cc42b40f829","Type":"ContainerStarted","Data":"65b689baccae75920c5e7d78443ff83582d2c7bd231b58e13262c01a9a8ed6ef"}
May 26 19:42:37.561250 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:37.561217    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-854dh" event={"ID":"97106aed-260f-4660-9104-3cc42b40f829","Type":"ContainerStarted","Data":"2f33e096d20bfc733c9b8196483a7a8de8c5ba83af4823fd999a6d5a498ff68c"}
May 26 19:42:37.561590 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:37.561256    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-854dh" event={"ID":"97106aed-260f-4660-9104-3cc42b40f829","Type":"ContainerStarted","Data":"546debaf709db9e80ad0030486066cede2c290fe188b3431e93b60fc6f7444cb"}
May 26 19:42:37.577281 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:37.577230    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-854dh" podStartSLOduration=130.411259502 podStartE2EDuration="2m11.577214729s" podCreationTimestamp="2026-05-26 19:40:26 +0000 UTC" firstStartedPulling="2026-05-26 19:42:36.197081214 +0000 UTC m=+130.676228840" lastFinishedPulling="2026-05-26 19:42:37.363036442 +0000 UTC m=+131.842184067" observedRunningTime="2026-05-26 19:42:37.576271223 +0000 UTC m=+132.055418878" watchObservedRunningTime="2026-05-26 19:42:37.577214729 +0000 UTC m=+132.056362354"
May 26 19:42:44.273160 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.273119    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rxtjs"]
May 26 19:42:44.275254 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.275238    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.278947 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.278898    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 19:42:44.278947 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.278946    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 19:42:44.279160 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.278898    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 19:42:44.279160 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.278928    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 19:42:44.279160 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.278930    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fr5np\""
May 26 19:42:44.293651 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.293621    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxtjs"]
May 26 19:42:44.332723 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.332683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099047a0-0464-41b9-9372-fece94307f2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.332723 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.332727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099047a0-0464-41b9-9372-fece94307f2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.333025 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.332752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-878p7\" (UniqueName: \"kubernetes.io/projected/099047a0-0464-41b9-9372-fece94307f2d-kube-api-access-878p7\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.333025 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.332877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099047a0-0464-41b9-9372-fece94307f2d-crio-socket\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.333025 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.332939    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099047a0-0464-41b9-9372-fece94307f2d-data-volume\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433504 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433460    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099047a0-0464-41b9-9372-fece94307f2d-crio-socket\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433504 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433509    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099047a0-0464-41b9-9372-fece94307f2d-data-volume\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433701 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433594    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/099047a0-0464-41b9-9372-fece94307f2d-crio-socket\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433701 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433694    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099047a0-0464-41b9-9372-fece94307f2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433785 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433729    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099047a0-0464-41b9-9372-fece94307f2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433785 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433756    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-878p7\" (UniqueName: \"kubernetes.io/projected/099047a0-0464-41b9-9372-fece94307f2d-kube-api-access-878p7\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.433874 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.433786    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/099047a0-0464-41b9-9372-fece94307f2d-data-volume\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.434283 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.434262    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/099047a0-0464-41b9-9372-fece94307f2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.436196 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.436177    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/099047a0-0464-41b9-9372-fece94307f2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.447546 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.447515    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-878p7\" (UniqueName: \"kubernetes.io/projected/099047a0-0464-41b9-9372-fece94307f2d-kube-api-access-878p7\") pod \"insights-runtime-extractor-rxtjs\" (UID: \"099047a0-0464-41b9-9372-fece94307f2d\") " pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.583746 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.583657    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxtjs"
May 26 19:42:44.712192 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.712158    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxtjs"]
May 26 19:42:44.715510 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:42:44.715486    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod099047a0_0464_41b9_9372_fece94307f2d.slice/crio-122763953cb84548c099234aa0932deb819818ee3f7780040ce751169e3b5353 WatchSource:0}: Error finding container 122763953cb84548c099234aa0932deb819818ee3f7780040ce751169e3b5353: Status 404 returned error can't find the container with id 122763953cb84548c099234aa0932deb819818ee3f7780040ce751169e3b5353
May 26 19:42:44.777327 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:44.777279    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" podUID="abb6e1b5-aa91-409c-a2bc-a3107d1fd166" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:42:45.585479 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:45.585442    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxtjs" event={"ID":"099047a0-0464-41b9-9372-fece94307f2d","Type":"ContainerStarted","Data":"43244e331b232911b26af5a8c95bf19619d22cc7ecf0fa95d5dd07b18354e07d"}
May 26 19:42:45.585479 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:45.585478    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxtjs" event={"ID":"099047a0-0464-41b9-9372-fece94307f2d","Type":"ContainerStarted","Data":"56e5299eae7b31306317bae6de53e7d016ad0e07fe7151254427661d8835f184"}
May 26 19:42:45.585479 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:45.585488    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxtjs" event={"ID":"099047a0-0464-41b9-9372-fece94307f2d","Type":"ContainerStarted","Data":"122763953cb84548c099234aa0932deb819818ee3f7780040ce751169e3b5353"}
May 26 19:42:47.592866 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:47.592825    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxtjs" event={"ID":"099047a0-0464-41b9-9372-fece94307f2d","Type":"ContainerStarted","Data":"a4555818aed5b87c04d16605fb3a3439cd172a5f99cdead504cbcd841954ab31"}
May 26 19:42:47.610302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:47.610243    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rxtjs" podStartSLOduration=1.232414682 podStartE2EDuration="3.610227558s" podCreationTimestamp="2026-05-26 19:42:44 +0000 UTC" firstStartedPulling="2026-05-26 19:42:44.766730367 +0000 UTC m=+139.245877993" lastFinishedPulling="2026-05-26 19:42:47.144543228 +0000 UTC m=+141.623690869" observedRunningTime="2026-05-26 19:42:47.609468505 +0000 UTC m=+142.088616150" watchObservedRunningTime="2026-05-26 19:42:47.610227558 +0000 UTC m=+142.089375202"
May 26 19:42:54.777112 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:54.777070    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" podUID="abb6e1b5-aa91-409c-a2bc-a3107d1fd166" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:42:58.573718 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.573674    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7kcc4"]
May 26 19:42:58.576109 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.576090    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.580264 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.580229    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 19:42:58.580389 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.580266    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 19:42:58.580389 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.580381    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 19:42:58.580967 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.580952    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 19:42:58.581583 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.581562    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 19:42:58.581583 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.581590    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 19:42:58.581755 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.581614    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6vsnp\""
May 26 19:42:58.648672 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-sys\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648672 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-root\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-wtmp\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-textfile\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-metrics-client-ca\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-tls\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.648889 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwgz\" (UniqueName: \"kubernetes.io/projected/4315d980-dcca-4376-9257-3d1e59a441ab-kube-api-access-nnwgz\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.649123 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.648900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749316 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749278    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-tls\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749316 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749316    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwgz\" (UniqueName: \"kubernetes.io/projected/4315d980-dcca-4376-9257-3d1e59a441ab-kube-api-access-nnwgz\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749532 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749436    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749532 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749507    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-sys\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749532 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749526    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-root\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749550    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-wtmp\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749582    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-textfile\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749608    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-metrics-client-ca\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749624    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-sys\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749632    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-root\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749634    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.749975 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749717    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-wtmp\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.750042 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.749985    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-textfile\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.750103 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.750080    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-accelerators-collector-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.750159 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.750141    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4315d980-dcca-4376-9257-3d1e59a441ab-metrics-client-ca\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.751976 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.751956    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.752073 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.752038    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4315d980-dcca-4376-9257-3d1e59a441ab-node-exporter-tls\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.763046 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.763023    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwgz\" (UniqueName: \"kubernetes.io/projected/4315d980-dcca-4376-9257-3d1e59a441ab-kube-api-access-nnwgz\") pod \"node-exporter-7kcc4\" (UID: \"4315d980-dcca-4376-9257-3d1e59a441ab\") " pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.885245 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:58.885151    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7kcc4"
May 26 19:42:58.894004 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:42:58.893960    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4315d980_dcca_4376_9257_3d1e59a441ab.slice/crio-4ae83edc8588bd22c5bac5e338041477f373bbe793f55662bfb310e5f0bd3b55 WatchSource:0}: Error finding container 4ae83edc8588bd22c5bac5e338041477f373bbe793f55662bfb310e5f0bd3b55: Status 404 returned error can't find the container with id 4ae83edc8588bd22c5bac5e338041477f373bbe793f55662bfb310e5f0bd3b55
May 26 19:42:59.628846 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:42:59.628803    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kcc4" event={"ID":"4315d980-dcca-4376-9257-3d1e59a441ab","Type":"ContainerStarted","Data":"4ae83edc8588bd22c5bac5e338041477f373bbe793f55662bfb310e5f0bd3b55"}
May 26 19:43:00.632520 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:00.632479    2561 generic.go:358] "Generic (PLEG): container finished" podID="4315d980-dcca-4376-9257-3d1e59a441ab" containerID="0c387317b5fc1d14119625b599d569b50f6c1a3fdc7ab465403256827dea39cb" exitCode=0
May 26 19:43:00.632956 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:00.632561    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kcc4" event={"ID":"4315d980-dcca-4376-9257-3d1e59a441ab","Type":"ContainerDied","Data":"0c387317b5fc1d14119625b599d569b50f6c1a3fdc7ab465403256827dea39cb"}
May 26 19:43:01.638640 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:01.638604    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kcc4" event={"ID":"4315d980-dcca-4376-9257-3d1e59a441ab","Type":"ContainerStarted","Data":"800369eed26cfd4206396bb2750a580559f8dc4d6fbe786d14023507219e5e05"}
May 26 19:43:01.638640 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:01.638642    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7kcc4" event={"ID":"4315d980-dcca-4376-9257-3d1e59a441ab","Type":"ContainerStarted","Data":"0b5e549c05a67c639a0187e35dbeffc5fdb3c14a89d51a703b772565c2f8f2a4"}
May 26 19:43:01.660451 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:01.660393    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7kcc4" podStartSLOduration=2.761982353 podStartE2EDuration="3.660379189s" podCreationTimestamp="2026-05-26 19:42:58 +0000 UTC" firstStartedPulling="2026-05-26 19:42:58.896110773 +0000 UTC m=+153.375258397" lastFinishedPulling="2026-05-26 19:42:59.794507611 +0000 UTC m=+154.273655233" observedRunningTime="2026-05-26 19:43:01.659808499 +0000 UTC m=+156.138956143" watchObservedRunningTime="2026-05-26 19:43:01.660379189 +0000 UTC m=+156.139526834"
May 26 19:43:04.777582 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:04.777491    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" podUID="abb6e1b5-aa91-409c-a2bc-a3107d1fd166" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:43:04.777582 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:04.777566    2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj"
May 26 19:43:04.778189 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:04.778155    2561 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"14feed58b72cca4e0823c0da6a6cc44e73182267558f94d4368585e2fa125e19"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 19:43:04.778246 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:04.778230    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" podUID="abb6e1b5-aa91-409c-a2bc-a3107d1fd166" containerName="service-proxy" containerID="cri-o://14feed58b72cca4e0823c0da6a6cc44e73182267558f94d4368585e2fa125e19" gracePeriod=30
May 26 19:43:05.650883 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:05.650842    2561 generic.go:358] "Generic (PLEG): container finished" podID="abb6e1b5-aa91-409c-a2bc-a3107d1fd166" containerID="14feed58b72cca4e0823c0da6a6cc44e73182267558f94d4368585e2fa125e19" exitCode=2
May 26 19:43:05.651082 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:05.650931    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerDied","Data":"14feed58b72cca4e0823c0da6a6cc44e73182267558f94d4368585e2fa125e19"}
May 26 19:43:05.651082 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:05.650971    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8676455879-s7cmj" event={"ID":"abb6e1b5-aa91-409c-a2bc-a3107d1fd166","Type":"ContainerStarted","Data":"3e4cecc7c665ff10fed476ed0777f92ed8a23435a7ca30f28d9022ff902e1e21"}
May 26 19:43:06.835447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:06.835401    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69cf8fbf57-glhzf"]
May 26 19:43:06.835936 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:43:06.835656    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf" podUID="5a7345c1-e9d2-402d-b489-7c09c394a636"
May 26 19:43:07.567170 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:43:07.567124    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lcmsw" podUID="1a9c632b-2ab2-4084-9d38-b98c5ac60f72"
May 26 19:43:07.572323 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:43:07.572294    2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2m6fd" podUID="8b228343-2f31-4961-a671-f4ed4737f117"
May 26 19:43:07.656358 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.656323    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:07.656577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.656328    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:43:07.660489 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.660463    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:43:07.726802 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.726775    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.726945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.726841    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjq8d\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.726945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.726882    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.727034 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.726906    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.727034 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.726986    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.727034 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.727020    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.727185 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.727042    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token\") pod \"5a7345c1-e9d2-402d-b489-7c09c394a636\" (UID: \"5a7345c1-e9d2-402d-b489-7c09c394a636\") "
May 26 19:43:07.727793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.727295    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:43:07.727793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.727353    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:43:07.727793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.727360    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:43:07.729449 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.729419    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:43:07.729449 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.729439    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:43:07.729578 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.729529    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:43:07.729578 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.729538    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d" (OuterVolumeSpecName: "kube-api-access-bjq8d") pod "5a7345c1-e9d2-402d-b489-7c09c394a636" (UID: "5a7345c1-e9d2-402d-b489-7c09c394a636"). InnerVolumeSpecName "kube-api-access-bjq8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828024    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-certificates\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828054    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-image-registry-private-configuration\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828065    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-bound-sa-token\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828075    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a7345c1-e9d2-402d-b489-7c09c394a636-trusted-ca\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828083    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjq8d\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-kube-api-access-bjq8d\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828093    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a7345c1-e9d2-402d-b489-7c09c394a636-installation-pull-secrets\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:07.828113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:07.828101    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a7345c1-e9d2-402d-b489-7c09c394a636-ca-trust-extracted\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:08.658618 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:08.658583    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69cf8fbf57-glhzf"
May 26 19:43:08.691413 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:08.691374    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69cf8fbf57-glhzf"]
May 26 19:43:08.695063 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:08.695041    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69cf8fbf57-glhzf"]
May 26 19:43:08.836650 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:08.836607    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a7345c1-e9d2-402d-b489-7c09c394a636-registry-tls\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:43:10.132173 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:10.132142    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7345c1-e9d2-402d-b489-7c09c394a636" path="/var/lib/kubelet/pods/5a7345c1-e9d2-402d-b489-7c09c394a636/volumes"
May 26 19:43:12.464190 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.464150    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:12.464190 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.464195    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:43:12.466715 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.466694    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b228343-2f31-4961-a671-f4ed4737f117-cert\") pod \"ingress-canary-2m6fd\" (UID: \"8b228343-2f31-4961-a671-f4ed4737f117\") " pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:43:12.466788 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.466732    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a9c632b-2ab2-4084-9d38-b98c5ac60f72-metrics-tls\") pod \"dns-default-lcmsw\" (UID: \"1a9c632b-2ab2-4084-9d38-b98c5ac60f72\") " pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:12.760190 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.760111    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4rbd\""
May 26 19:43:12.768444 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.768423    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:12.894292 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:12.894253    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lcmsw"]
May 26 19:43:12.897660 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:43:12.897630    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9c632b_2ab2_4084_9d38_b98c5ac60f72.slice/crio-30d00485a89a1cedacf4129ad4eedc8343d4f3482da5524f0f97e67296043c84 WatchSource:0}: Error finding container 30d00485a89a1cedacf4129ad4eedc8343d4f3482da5524f0f97e67296043c84: Status 404 returned error can't find the container with id 30d00485a89a1cedacf4129ad4eedc8343d4f3482da5524f0f97e67296043c84
May 26 19:43:13.671782 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:13.671744    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcmsw" event={"ID":"1a9c632b-2ab2-4084-9d38-b98c5ac60f72","Type":"ContainerStarted","Data":"30d00485a89a1cedacf4129ad4eedc8343d4f3482da5524f0f97e67296043c84"}
May 26 19:43:14.676506 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:14.676415    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcmsw" event={"ID":"1a9c632b-2ab2-4084-9d38-b98c5ac60f72","Type":"ContainerStarted","Data":"b53f9b8d049e1ba5c363defccf34a5245d10f5acd9a2dbf47d7e97ec9e423219"}
May 26 19:43:14.676506 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:14.676452    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcmsw" event={"ID":"1a9c632b-2ab2-4084-9d38-b98c5ac60f72","Type":"ContainerStarted","Data":"29f172c1c433a70a6f6a8d04519e82a3a03fb520df0e2c5e7d46a7ae759b2014"}
May 26 19:43:14.677000 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:14.676551    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:14.694860 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:14.694791    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lcmsw" podStartSLOduration=129.390074654 podStartE2EDuration="2m10.694770243s" podCreationTimestamp="2026-05-26 19:41:04 +0000 UTC" firstStartedPulling="2026-05-26 19:43:12.900031805 +0000 UTC m=+167.379179426" lastFinishedPulling="2026-05-26 19:43:14.204727379 +0000 UTC m=+168.683875015" observedRunningTime="2026-05-26 19:43:14.692352057 +0000 UTC m=+169.171499714" watchObservedRunningTime="2026-05-26 19:43:14.694770243 +0000 UTC m=+169.173917891"
May 26 19:43:20.128341 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:20.128299    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:43:20.131213 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:20.131178    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nxp95\""
May 26 19:43:20.139416 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:20.139393    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2m6fd"
May 26 19:43:20.260369 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:20.260297    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2m6fd"]
May 26 19:43:20.263045 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:43:20.263015    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b228343_2f31_4961_a671_f4ed4737f117.slice/crio-d17fb359b2b297bfa04cc1786697d7279040f14165e3add3ed544e69d06d55c5 WatchSource:0}: Error finding container d17fb359b2b297bfa04cc1786697d7279040f14165e3add3ed544e69d06d55c5: Status 404 returned error can't find the container with id d17fb359b2b297bfa04cc1786697d7279040f14165e3add3ed544e69d06d55c5
May 26 19:43:20.697387 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:20.697345    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m6fd" event={"ID":"8b228343-2f31-4961-a671-f4ed4737f117","Type":"ContainerStarted","Data":"d17fb359b2b297bfa04cc1786697d7279040f14165e3add3ed544e69d06d55c5"}
May 26 19:43:22.703825 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:22.703788    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2m6fd" event={"ID":"8b228343-2f31-4961-a671-f4ed4737f117","Type":"ContainerStarted","Data":"cfa7315d03705e8a9e04ba2743ccff0d4fdfb1f77a1a225c46d850ce34976487"}
May 26 19:43:22.727411 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:22.727352    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2m6fd" podStartSLOduration=137.203636448 podStartE2EDuration="2m18.727335314s" podCreationTimestamp="2026-05-26 19:41:04 +0000 UTC" firstStartedPulling="2026-05-26 19:43:20.264957043 +0000 UTC m=+174.744104668" lastFinishedPulling="2026-05-26 19:43:21.788655901 +0000 UTC m=+176.267803534" observedRunningTime="2026-05-26 19:43:22.72720844 +0000 UTC m=+177.206356083" watchObservedRunningTime="2026-05-26 19:43:22.727335314 +0000 UTC m=+177.206482960"
May 26 19:43:24.681939 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:24.681888    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lcmsw"
May 26 19:43:38.061005 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:38.060976    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/init-textfile/0.log"
May 26 19:43:38.262394 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:38.262363    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/node-exporter/0.log"
May 26 19:43:38.462378 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:38.462337    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/kube-rbac-proxy/0.log"
May 26 19:43:45.060596 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:43:45.060562    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m6fd_8b228343-2f31-4961-a671-f4ed4737f117/serve-healthcheck-canary/0.log"
May 26 19:45:26.063000 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:26.062973    2561 kubelet.go:1628] "Image garbage collection succeeded"
May 26 19:45:34.119157 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.119124    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"]
May 26 19:45:34.122389 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.122373    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.126811 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.126786    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 26 19:45:34.127148 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.127132    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6xs6s\""
May 26 19:45:34.127263 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.127246    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 26 19:45:34.141133 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.141098    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"]
May 26 19:45:34.273614 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.273563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc3c5-2a6d-4121-8583-900613efcef5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.273614 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.273619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42ds\" (UniqueName: \"kubernetes.io/projected/3c8cc3c5-2a6d-4121-8583-900613efcef5-kube-api-access-z42ds\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.374827 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.374717    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc3c5-2a6d-4121-8583-900613efcef5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.374827 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.374783    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z42ds\" (UniqueName: \"kubernetes.io/projected/3c8cc3c5-2a6d-4121-8583-900613efcef5-kube-api-access-z42ds\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.375155 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.375133    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c8cc3c5-2a6d-4121-8583-900613efcef5-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.383811 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.383781    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42ds\" (UniqueName: \"kubernetes.io/projected/3c8cc3c5-2a6d-4121-8583-900613efcef5-kube-api-access-z42ds\") pod \"cert-manager-operator-controller-manager-54b9655956-k99t6\" (UID: \"3c8cc3c5-2a6d-4121-8583-900613efcef5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.431793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.431756    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"
May 26 19:45:34.561128 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.561093    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6"]
May 26 19:45:34.563906 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:45:34.563880    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8cc3c5_2a6d_4121_8583_900613efcef5.slice/crio-08cf7c3138f0b4d399d2ad120877dab99c42dd490c2b0d82cb6f8f68ab3522db WatchSource:0}: Error finding container 08cf7c3138f0b4d399d2ad120877dab99c42dd490c2b0d82cb6f8f68ab3522db: Status 404 returned error can't find the container with id 08cf7c3138f0b4d399d2ad120877dab99c42dd490c2b0d82cb6f8f68ab3522db
May 26 19:45:34.566240 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:34.566224    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:45:35.035800 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:35.035760    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6" event={"ID":"3c8cc3c5-2a6d-4121-8583-900613efcef5","Type":"ContainerStarted","Data":"08cf7c3138f0b4d399d2ad120877dab99c42dd490c2b0d82cb6f8f68ab3522db"}
May 26 19:45:37.042674 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:37.042633    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6" event={"ID":"3c8cc3c5-2a6d-4121-8583-900613efcef5","Type":"ContainerStarted","Data":"3863df368ba8a6ef270305aba10926bf81ba522c1c1b2d8e814fc4b26741ec03"}
May 26 19:45:37.064960 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:37.064891    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-k99t6" podStartSLOduration=0.992841444 podStartE2EDuration="3.064877488s" podCreationTimestamp="2026-05-26 19:45:34 +0000 UTC" firstStartedPulling="2026-05-26 19:45:34.566350361 +0000 UTC m=+309.045497983" lastFinishedPulling="2026-05-26 19:45:36.638386389 +0000 UTC m=+311.117534027" observedRunningTime="2026-05-26 19:45:37.06341166 +0000 UTC m=+311.542559302" watchObservedRunningTime="2026-05-26 19:45:37.064877488 +0000 UTC m=+311.544025130"
May 26 19:45:56.220021 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.219984    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"]
May 26 19:45:56.223214 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.223197    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.226187 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.226164    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 26 19:45:56.227310 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.227295    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 26 19:45:56.227401 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.227297    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x4nkf\""
May 26 19:45:56.228726 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.228699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sslkm\" (UniqueName: \"kubernetes.io/projected/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-kube-api-access-sslkm\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.228815 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.228750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-tmp\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.232884 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.232861    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"]
May 26 19:45:56.329506 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.329461    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sslkm\" (UniqueName: \"kubernetes.io/projected/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-kube-api-access-sslkm\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.329506 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.329509    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-tmp\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.329842 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.329822    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-tmp\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.341377 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.341351    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sslkm\" (UniqueName: \"kubernetes.io/projected/3db9f6a4-8c08-4379-bfb9-6d8664c201fb-kube-api-access-sslkm\") pod \"openshift-lws-operator-bfc7f696d-k8t2x\" (UID: \"3db9f6a4-8c08-4379-bfb9-6d8664c201fb\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.532532 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.532450    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"
May 26 19:45:56.661615 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:56.661580    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x"]
May 26 19:45:56.664729 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:45:56.664689    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3db9f6a4_8c08_4379_bfb9_6d8664c201fb.slice/crio-50c5d05ef4f844406e24ab0bc7f697cf71a9ac4ebbeb8ae186a87d78e8613cfe WatchSource:0}: Error finding container 50c5d05ef4f844406e24ab0bc7f697cf71a9ac4ebbeb8ae186a87d78e8613cfe: Status 404 returned error can't find the container with id 50c5d05ef4f844406e24ab0bc7f697cf71a9ac4ebbeb8ae186a87d78e8613cfe
May 26 19:45:57.096760 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:45:57.096727    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x" event={"ID":"3db9f6a4-8c08-4379-bfb9-6d8664c201fb","Type":"ContainerStarted","Data":"50c5d05ef4f844406e24ab0bc7f697cf71a9ac4ebbeb8ae186a87d78e8613cfe"}
May 26 19:46:00.105778 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:00.105741    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x" event={"ID":"3db9f6a4-8c08-4379-bfb9-6d8664c201fb","Type":"ContainerStarted","Data":"de82571262904d212fe36255f892247d80af95ae0b7525615d235a0ff4e3b949"}
May 26 19:46:00.121929 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:00.121861    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-k8t2x" podStartSLOduration=1.62955087 podStartE2EDuration="4.121843981s" podCreationTimestamp="2026-05-26 19:45:56 +0000 UTC" firstStartedPulling="2026-05-26 19:45:56.666272495 +0000 UTC m=+331.145420117" lastFinishedPulling="2026-05-26 19:45:59.158565589 +0000 UTC m=+333.637713228" observedRunningTime="2026-05-26 19:46:00.121387464 +0000 UTC m=+334.600535109" watchObservedRunningTime="2026-05-26 19:46:00.121843981 +0000 UTC m=+334.600991626"
May 26 19:46:16.043150 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.043112    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"]
May 26 19:46:16.045308 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.045291    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.048600 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.048551    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 19:46:16.048932 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.048886    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 19:46:16.049054 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.048954    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 19:46:16.049264 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.049246    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 19:46:16.049371 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.049294    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x9dkm\""
May 26 19:46:16.062099 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.062071    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"]
May 26 19:46:16.079134 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.079091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj9sx\" (UniqueName: \"kubernetes.io/projected/32faa720-759e-43e6-9f02-6e0e6cdd62fa-kube-api-access-sj9sx\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.079285 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.079143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.079285 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.079254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.179812 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.179782    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sj9sx\" (UniqueName: \"kubernetes.io/projected/32faa720-759e-43e6-9f02-6e0e6cdd62fa-kube-api-access-sj9sx\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.180101 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.179819    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.180101 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.179862    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.182451 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.182420    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.182580 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.182459    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32faa720-759e-43e6-9f02-6e0e6cdd62fa-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.193684 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.193652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj9sx\" (UniqueName: \"kubernetes.io/projected/32faa720-759e-43e6-9f02-6e0e6cdd62fa-kube-api-access-sj9sx\") pod \"opendatahub-operator-controller-manager-8645bcd494-wwft8\" (UID: \"32faa720-759e-43e6-9f02-6e0e6cdd62fa\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.354930 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.354810    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:16.502761 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:16.502721    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"]
May 26 19:46:16.505903 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:46:16.505877    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32faa720_759e_43e6_9f02_6e0e6cdd62fa.slice/crio-6f04143d0477b810cf69c70da8d7c082ee56a4db16cab8b4bf20200ad9984a7b WatchSource:0}: Error finding container 6f04143d0477b810cf69c70da8d7c082ee56a4db16cab8b4bf20200ad9984a7b: Status 404 returned error can't find the container with id 6f04143d0477b810cf69c70da8d7c082ee56a4db16cab8b4bf20200ad9984a7b
May 26 19:46:17.153255 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:17.153220    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8" event={"ID":"32faa720-759e-43e6-9f02-6e0e6cdd62fa","Type":"ContainerStarted","Data":"6f04143d0477b810cf69c70da8d7c082ee56a4db16cab8b4bf20200ad9984a7b"}
May 26 19:46:19.161335 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:19.161289    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8" event={"ID":"32faa720-759e-43e6-9f02-6e0e6cdd62fa","Type":"ContainerStarted","Data":"11861d0d1b7ba3e371803981ea1b673cc5a700d7ec8230e46da3cbfb714e7627"}
May 26 19:46:19.161763 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:19.161437    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:19.184266 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:19.184215    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8" podStartSLOduration=0.705635525 podStartE2EDuration="3.184199344s" podCreationTimestamp="2026-05-26 19:46:16 +0000 UTC" firstStartedPulling="2026-05-26 19:46:16.507755298 +0000 UTC m=+350.986902923" lastFinishedPulling="2026-05-26 19:46:18.986319118 +0000 UTC m=+353.465466742" observedRunningTime="2026-05-26 19:46:19.182140753 +0000 UTC m=+353.661288399" watchObservedRunningTime="2026-05-26 19:46:19.184199344 +0000 UTC m=+353.663346989"
May 26 19:46:30.167496 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:30.167457    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-wwft8"
May 26 19:46:36.371288 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.371251    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7hg4w"]
May 26 19:46:36.373290 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.373276    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:36.375991 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.375965    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 26 19:46:36.375991 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.375984    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v9lbn\""
May 26 19:46:36.383780 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.383757    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7hg4w"]
May 26 19:46:36.438030 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.437891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzcpc\" (UniqueName: \"kubernetes.io/projected/ac759abb-6062-4ccb-8e5c-419e74e2a61d-kube-api-access-pzcpc\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:36.438200 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.438068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:36.539081 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.539037    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzcpc\" (UniqueName: \"kubernetes.io/projected/ac759abb-6062-4ccb-8e5c-419e74e2a61d-kube-api-access-pzcpc\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:36.539284 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.539169    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:36.539352 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:36.539299    2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 26 19:46:36.539407 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:36.539356    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert podName:ac759abb-6062-4ccb-8e5c-419e74e2a61d nodeName:}" failed. No retries permitted until 2026-05-26 19:46:37.039341282 +0000 UTC m=+371.518488913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert") pod "odh-model-controller-858dbf95b8-7hg4w" (UID: "ac759abb-6062-4ccb-8e5c-419e74e2a61d") : secret "odh-model-controller-webhook-cert" not found
May 26 19:46:36.547776 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:36.547750    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzcpc\" (UniqueName: \"kubernetes.io/projected/ac759abb-6062-4ccb-8e5c-419e74e2a61d-kube-api-access-pzcpc\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:37.044133 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:37.044092    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:37.046716 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:37.046692    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac759abb-6062-4ccb-8e5c-419e74e2a61d-cert\") pod \"odh-model-controller-858dbf95b8-7hg4w\" (UID: \"ac759abb-6062-4ccb-8e5c-419e74e2a61d\") " pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:37.282502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:37.282464    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:37.430393 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:37.430354    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-7hg4w"]
May 26 19:46:37.434511 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:46:37.434483    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac759abb_6062_4ccb_8e5c_419e74e2a61d.slice/crio-8b3bfe9d1a365d6d38a4c47a1b70dec0ad85f0f1e88137879f6230a1745740a0 WatchSource:0}: Error finding container 8b3bfe9d1a365d6d38a4c47a1b70dec0ad85f0f1e88137879f6230a1745740a0: Status 404 returned error can't find the container with id 8b3bfe9d1a365d6d38a4c47a1b70dec0ad85f0f1e88137879f6230a1745740a0
May 26 19:46:38.215580 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:38.215536    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w" event={"ID":"ac759abb-6062-4ccb-8e5c-419e74e2a61d","Type":"ContainerStarted","Data":"8b3bfe9d1a365d6d38a4c47a1b70dec0ad85f0f1e88137879f6230a1745740a0"}
May 26 19:46:41.218027 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.217991    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hs4nk"]
May 26 19:46:41.220061 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.220046    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.222555 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.222531    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 26 19:46:41.222555 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.222545    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fps2m\""
May 26 19:46:41.228533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.228400    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hs4nk"]
May 26 19:46:41.229042 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.228888    2561 generic.go:358] "Generic (PLEG): container finished" podID="ac759abb-6062-4ccb-8e5c-419e74e2a61d" containerID="7bd995eafd1c98bdff5cfbe814558e0b54c568b7f6dd4b9f032917e13c430acb" exitCode=1
May 26 19:46:41.229042 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.229008    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w" event={"ID":"ac759abb-6062-4ccb-8e5c-419e74e2a61d","Type":"ContainerDied","Data":"7bd995eafd1c98bdff5cfbe814558e0b54c568b7f6dd4b9f032917e13c430acb"}
May 26 19:46:41.229308 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.229291    2561 scope.go:117] "RemoveContainer" containerID="7bd995eafd1c98bdff5cfbe814558e0b54c568b7f6dd4b9f032917e13c430acb"
May 26 19:46:41.379265 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.379216    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnvv2\" (UniqueName: \"kubernetes.io/projected/871982d9-3484-4e94-94f0-e2b738fd5400-kube-api-access-gnvv2\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.379456 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.379280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.479632 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.479606    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.479758 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.479658    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnvv2\" (UniqueName: \"kubernetes.io/projected/871982d9-3484-4e94-94f0-e2b738fd5400-kube-api-access-gnvv2\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.479798 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:41.479754    2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 26 19:46:41.479831 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:41.479817    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert podName:871982d9-3484-4e94-94f0-e2b738fd5400 nodeName:}" failed. No retries permitted until 2026-05-26 19:46:41.979799538 +0000 UTC m=+376.458947180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert") pod "kserve-controller-manager-856948b99f-hs4nk" (UID: "871982d9-3484-4e94-94f0-e2b738fd5400") : secret "kserve-webhook-server-cert" not found
May 26 19:46:41.491557 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.491516    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnvv2\" (UniqueName: \"kubernetes.io/projected/871982d9-3484-4e94-94f0-e2b738fd5400-kube-api-access-gnvv2\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.983691 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:41.983648    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:41.983878 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:41.983804    2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 26 19:46:41.983878 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:46:41.983875    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert podName:871982d9-3484-4e94-94f0-e2b738fd5400 nodeName:}" failed. No retries permitted until 2026-05-26 19:46:42.983860212 +0000 UTC m=+377.463007833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert") pod "kserve-controller-manager-856948b99f-hs4nk" (UID: "871982d9-3484-4e94-94f0-e2b738fd5400") : secret "kserve-webhook-server-cert" not found
May 26 19:46:42.233372 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:42.233336    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w" event={"ID":"ac759abb-6062-4ccb-8e5c-419e74e2a61d","Type":"ContainerStarted","Data":"2cc158e687e40e645db3e35cb6a73c90dbd68aff0fb8086a77921f053b4e1cf0"}
May 26 19:46:42.233875 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:42.233487    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:42.253997 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:42.253945    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w" podStartSLOduration=2.243717216 podStartE2EDuration="6.253929731s" podCreationTimestamp="2026-05-26 19:46:36 +0000 UTC" firstStartedPulling="2026-05-26 19:46:37.435867793 +0000 UTC m=+371.915015418" lastFinishedPulling="2026-05-26 19:46:41.446080308 +0000 UTC m=+375.925227933" observedRunningTime="2026-05-26 19:46:42.252532185 +0000 UTC m=+376.731679829" watchObservedRunningTime="2026-05-26 19:46:42.253929731 +0000 UTC m=+376.733077367"
May 26 19:46:42.994269 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:42.994225    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:42.996817 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:42.996790    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/871982d9-3484-4e94-94f0-e2b738fd5400-cert\") pod \"kserve-controller-manager-856948b99f-hs4nk\" (UID: \"871982d9-3484-4e94-94f0-e2b738fd5400\") " pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:43.033131 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.033091    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:43.165451 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.165357    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-hs4nk"]
May 26 19:46:43.167805 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:46:43.167779    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871982d9_3484_4e94_94f0_e2b738fd5400.slice/crio-ac435e2079fc1c6828929f9895598c06a776ccdf1d01adab901ebf2ba46718d0 WatchSource:0}: Error finding container ac435e2079fc1c6828929f9895598c06a776ccdf1d01adab901ebf2ba46718d0: Status 404 returned error can't find the container with id ac435e2079fc1c6828929f9895598c06a776ccdf1d01adab901ebf2ba46718d0
May 26 19:46:43.237847 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.237810    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk" event={"ID":"871982d9-3484-4e94-94f0-e2b738fd5400","Type":"ContainerStarted","Data":"ac435e2079fc1c6828929f9895598c06a776ccdf1d01adab901ebf2ba46718d0"}
May 26 19:46:43.813102 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.813063    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"]
May 26 19:46:43.815887 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.815860    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:43.819266 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.819234    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 26 19:46:43.819266 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.819250    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 26 19:46:43.819546 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.819519    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 19:46:43.819634 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.819550    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 19:46:43.829612 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.829581    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"]
May 26 19:46:43.901533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.901491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhgw\" (UniqueName: \"kubernetes.io/projected/67d73c45-8b17-4d7c-bcff-10e4605c540a-kube-api-access-tvhgw\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:43.901533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.901540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d73c45-8b17-4d7c-bcff-10e4605c540a-tls-certs\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:43.901762 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:43.901557    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d73c45-8b17-4d7c-bcff-10e4605c540a-tmp\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.003076 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.003020    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhgw\" (UniqueName: \"kubernetes.io/projected/67d73c45-8b17-4d7c-bcff-10e4605c540a-kube-api-access-tvhgw\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.003270 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.003092    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d73c45-8b17-4d7c-bcff-10e4605c540a-tls-certs\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.003270 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.003114    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d73c45-8b17-4d7c-bcff-10e4605c540a-tmp\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.005705 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.005672    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67d73c45-8b17-4d7c-bcff-10e4605c540a-tmp\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.005847 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.005798    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67d73c45-8b17-4d7c-bcff-10e4605c540a-tls-certs\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.011685 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.011652    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhgw\" (UniqueName: \"kubernetes.io/projected/67d73c45-8b17-4d7c-bcff-10e4605c540a-kube-api-access-tvhgw\") pod \"kube-auth-proxy-646c6699bc-xkrwz\" (UID: \"67d73c45-8b17-4d7c-bcff-10e4605c540a\") " pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.130130 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.130030    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"
May 26 19:46:44.292555 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:44.292518    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz"]
May 26 19:46:44.296581 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:46:44.296531    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d73c45_8b17_4d7c_bcff_10e4605c540a.slice/crio-6acd8868085954cb73b88c776a83948cb3fb186e783821e98731dfe657e7c602 WatchSource:0}: Error finding container 6acd8868085954cb73b88c776a83948cb3fb186e783821e98731dfe657e7c602: Status 404 returned error can't find the container with id 6acd8868085954cb73b88c776a83948cb3fb186e783821e98731dfe657e7c602
May 26 19:46:45.246199 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:45.246164    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz" event={"ID":"67d73c45-8b17-4d7c-bcff-10e4605c540a","Type":"ContainerStarted","Data":"6acd8868085954cb73b88c776a83948cb3fb186e783821e98731dfe657e7c602"}
May 26 19:46:47.255380 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:47.255341    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk" event={"ID":"871982d9-3484-4e94-94f0-e2b738fd5400","Type":"ContainerStarted","Data":"5a3601a8f466030aff0c829091b0b41865b4a5b3b7f31b881150132107bc12f7"}
May 26 19:46:47.255874 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:47.255483    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:46:47.273434 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:47.273378    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk" podStartSLOduration=2.526106787 podStartE2EDuration="6.273364881s" podCreationTimestamp="2026-05-26 19:46:41 +0000 UTC" firstStartedPulling="2026-05-26 19:46:43.169176897 +0000 UTC m=+377.648324519" lastFinishedPulling="2026-05-26 19:46:46.91643499 +0000 UTC m=+381.395582613" observedRunningTime="2026-05-26 19:46:47.271727888 +0000 UTC m=+381.750875528" watchObservedRunningTime="2026-05-26 19:46:47.273364881 +0000 UTC m=+381.752512524"
May 26 19:46:48.260177 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:48.260136    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz" event={"ID":"67d73c45-8b17-4d7c-bcff-10e4605c540a","Type":"ContainerStarted","Data":"71e9804d70647b19353a3f15daa4f9a1740ebe9adeec538978ccffd4b120d6eb"}
May 26 19:46:48.278400 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:48.278350    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-646c6699bc-xkrwz" podStartSLOduration=1.7836315109999998 podStartE2EDuration="5.278335309s" podCreationTimestamp="2026-05-26 19:46:43 +0000 UTC" firstStartedPulling="2026-05-26 19:46:44.298807587 +0000 UTC m=+378.777955216" lastFinishedPulling="2026-05-26 19:46:47.793511389 +0000 UTC m=+382.272659014" observedRunningTime="2026-05-26 19:46:48.277379115 +0000 UTC m=+382.756526776" watchObservedRunningTime="2026-05-26 19:46:48.278335309 +0000 UTC m=+382.757482952"
May 26 19:46:53.240793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:53.240758    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-7hg4w"
May 26 19:46:59.299142 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.299107    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"]
May 26 19:46:59.305134 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.305110    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.308544 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.308518    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 26 19:46:59.308668 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.308526    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 26 19:46:59.308668 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.308624    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-kbjq9\""
May 26 19:46:59.327534 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.327501    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"]
May 26 19:46:59.429183 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.429143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e817137-8b74-4195-b871-3673a60a3c1e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.429383 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.429202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mmv8\" (UniqueName: \"kubernetes.io/projected/6e817137-8b74-4195-b871-3673a60a3c1e-kube-api-access-6mmv8\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.530257 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.530213    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e817137-8b74-4195-b871-3673a60a3c1e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.530257 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.530253    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mmv8\" (UniqueName: \"kubernetes.io/projected/6e817137-8b74-4195-b871-3673a60a3c1e-kube-api-access-6mmv8\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.532870 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.532847    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e817137-8b74-4195-b871-3673a60a3c1e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.539409 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.539382    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mmv8\" (UniqueName: \"kubernetes.io/projected/6e817137-8b74-4195-b871-3673a60a3c1e-kube-api-access-6mmv8\") pod \"servicemesh-operator3-55f49c5f94-vs9d8\" (UID: \"6e817137-8b74-4195-b871-3673a60a3c1e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.614250 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.614153    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:46:59.750926 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:46:59.750876    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"]
May 26 19:46:59.753997 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:46:59.753962    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e817137_8b74_4195_b871_3673a60a3c1e.slice/crio-d9257592955cd1c03f05ebe70b5efc081a0c94166cd57435c4935ebd83861a91 WatchSource:0}: Error finding container d9257592955cd1c03f05ebe70b5efc081a0c94166cd57435c4935ebd83861a91: Status 404 returned error can't find the container with id d9257592955cd1c03f05ebe70b5efc081a0c94166cd57435c4935ebd83861a91
May 26 19:47:00.298602 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:00.298568    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8" event={"ID":"6e817137-8b74-4195-b871-3673a60a3c1e","Type":"ContainerStarted","Data":"d9257592955cd1c03f05ebe70b5efc081a0c94166cd57435c4935ebd83861a91"}
May 26 19:47:03.309708 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:03.309672    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8" event={"ID":"6e817137-8b74-4195-b871-3673a60a3c1e","Type":"ContainerStarted","Data":"e03755292c08dd650028cd7e66dfbd8638f2b13330be23ec0fe51100263b0171"}
May 26 19:47:03.310158 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:03.309809    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:47:03.334788 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:03.334732    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8" podStartSLOduration=1.677199554 podStartE2EDuration="4.334717983s" podCreationTimestamp="2026-05-26 19:46:59 +0000 UTC" firstStartedPulling="2026-05-26 19:46:59.757246295 +0000 UTC m=+394.236393932" lastFinishedPulling="2026-05-26 19:47:02.414764736 +0000 UTC m=+396.893912361" observedRunningTime="2026-05-26 19:47:03.33324732 +0000 UTC m=+397.812394965" watchObservedRunningTime="2026-05-26 19:47:03.334717983 +0000 UTC m=+397.813865627"
May 26 19:47:14.315557 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:14.315524    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vs9d8"
May 26 19:47:15.481043 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.481011    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"]
May 26 19:47:15.489416 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.489389    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.492508 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.492482    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 26 19:47:15.492669 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.492480    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 26 19:47:15.492669 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.492480    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 26 19:47:15.492852 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.492832    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hmbfr\""
May 26 19:47:15.495688 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.495667    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 19:47:15.497857 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.497803    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"]
May 26 19:47:15.547355 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccqw4\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-kube-api-access-ccqw4\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547355 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547361    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69f8a847-1d56-46a5-92a2-d1fc2430275f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547491    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.547577 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.547534    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.648734 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.648695    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.648734 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.648738    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccqw4\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-kube-api-access-ccqw4\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649057 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.648869    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649057 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.648936    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649057 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.648984    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649057 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.649019    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69f8a847-1d56-46a5-92a2-d1fc2430275f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649057 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.649048    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.649609 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.649561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.651755 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.651719    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.651871 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.651719    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.651969 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.651941    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69f8a847-1d56-46a5-92a2-d1fc2430275f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.651969 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.651947    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69f8a847-1d56-46a5-92a2-d1fc2430275f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.662166 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.662130    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.663093 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.663075    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccqw4\" (UniqueName: \"kubernetes.io/projected/69f8a847-1d56-46a5-92a2-d1fc2430275f-kube-api-access-ccqw4\") pod \"istiod-openshift-gateway-798958bb55-fc4lj\" (UID: \"69f8a847-1d56-46a5-92a2-d1fc2430275f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.800311 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.800214    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:15.965661 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:15.965582    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"]
May 26 19:47:15.970669 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:47:15.970640    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f8a847_1d56_46a5_92a2_d1fc2430275f.slice/crio-984831fec2059259eea7ab87e712bfcb3e8f2310a0fd719ac43de47b277a8ed9 WatchSource:0}: Error finding container 984831fec2059259eea7ab87e712bfcb3e8f2310a0fd719ac43de47b277a8ed9: Status 404 returned error can't find the container with id 984831fec2059259eea7ab87e712bfcb3e8f2310a0fd719ac43de47b277a8ed9
May 26 19:47:16.353599 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:16.353560    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj" event={"ID":"69f8a847-1d56-46a5-92a2-d1fc2430275f","Type":"ContainerStarted","Data":"984831fec2059259eea7ab87e712bfcb3e8f2310a0fd719ac43de47b277a8ed9"}
May 26 19:47:18.267153 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:18.267119    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-hs4nk"
May 26 19:47:18.848694 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:18.848652    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
May 26 19:47:18.848775 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:18.848758    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
May 26 19:47:19.366341 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:19.366306    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj" event={"ID":"69f8a847-1d56-46a5-92a2-d1fc2430275f","Type":"ContainerStarted","Data":"babf50f016e09e8823d7e46ddfae3e2a9a065b402fa7e4faaddef50164b3af38"}
May 26 19:47:19.366739 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:19.366522    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:47:19.368386 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:19.368351    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-fc4lj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 26 19:47:19.368510 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:19.368411    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj" podUID="69f8a847-1d56-46a5-92a2-d1fc2430275f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:47:19.387795 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:19.387738    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj" podStartSLOduration=1.512033673 podStartE2EDuration="4.387721483s" podCreationTimestamp="2026-05-26 19:47:15 +0000 UTC" firstStartedPulling="2026-05-26 19:47:15.972709922 +0000 UTC m=+410.451857546" lastFinishedPulling="2026-05-26 19:47:18.848397733 +0000 UTC m=+413.327545356" observedRunningTime="2026-05-26 19:47:19.386067919 +0000 UTC m=+413.865215565" watchObservedRunningTime="2026-05-26 19:47:19.387721483 +0000 UTC m=+413.866869126"
May 26 19:47:20.373032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:20.372984    2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-fc4lj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 26 19:47:20.373472 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:20.373049    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj" podUID="69f8a847-1d56-46a5-92a2-d1fc2430275f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:47:23.373774 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:47:23.373740    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-fc4lj"
May 26 19:48:09.955656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.955621    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"]
May 26 19:48:09.958803 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.958784    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:09.961467 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.961444    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s275q\""
May 26 19:48:09.961586 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.961464    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 19:48:09.962467 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.962450    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 26 19:48:09.962533 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.962512    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 19:48:09.967879 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.967854    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"]
May 26 19:48:09.993238 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:09.993208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqxln\" (UniqueName: \"kubernetes.io/projected/9c5a66c3-45fd-4791-bc0f-f117fa646ef4-kube-api-access-pqxln\") pod \"dns-operator-controller-manager-648d5c98bc-svsg6\" (UID: \"9c5a66c3-45fd-4791-bc0f-f117fa646ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:10.094296 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:10.094256    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqxln\" (UniqueName: \"kubernetes.io/projected/9c5a66c3-45fd-4791-bc0f-f117fa646ef4-kube-api-access-pqxln\") pod \"dns-operator-controller-manager-648d5c98bc-svsg6\" (UID: \"9c5a66c3-45fd-4791-bc0f-f117fa646ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:10.105942 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:10.105896    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqxln\" (UniqueName: \"kubernetes.io/projected/9c5a66c3-45fd-4791-bc0f-f117fa646ef4-kube-api-access-pqxln\") pod \"dns-operator-controller-manager-648d5c98bc-svsg6\" (UID: \"9c5a66c3-45fd-4791-bc0f-f117fa646ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:10.270104 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:10.269983    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:10.404901 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:10.404873    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"]
May 26 19:48:10.407634 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:48:10.407607    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c5a66c3_45fd_4791_bc0f_f117fa646ef4.slice/crio-f5ecbeab3146781f76089ae9fc2a99ff8247c7e6d5de5da5315754e0566b7b96 WatchSource:0}: Error finding container f5ecbeab3146781f76089ae9fc2a99ff8247c7e6d5de5da5315754e0566b7b96: Status 404 returned error can't find the container with id f5ecbeab3146781f76089ae9fc2a99ff8247c7e6d5de5da5315754e0566b7b96
May 26 19:48:10.534279 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:10.534176    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6" event={"ID":"9c5a66c3-45fd-4791-bc0f-f117fa646ef4","Type":"ContainerStarted","Data":"f5ecbeab3146781f76089ae9fc2a99ff8247c7e6d5de5da5315754e0566b7b96"}
May 26 19:48:12.694509 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.694477    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"]
May 26 19:48:12.697902 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.697881    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:12.700682 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.700665    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jfjw7\""
May 26 19:48:12.708634 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.708611    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"]
May 26 19:48:12.713667 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.713647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwk8\" (UniqueName: \"kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8\") pod \"limitador-operator-controller-manager-85c4996f8c-gbph7\" (UID: \"64433c06-446c-4001-b896-98b905c6c3cc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:12.815016 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.814967    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwk8\" (UniqueName: \"kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8\") pod \"limitador-operator-controller-manager-85c4996f8c-gbph7\" (UID: \"64433c06-446c-4001-b896-98b905c6c3cc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:12.823321 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:12.823287    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwk8\" (UniqueName: \"kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8\") pod \"limitador-operator-controller-manager-85c4996f8c-gbph7\" (UID: \"64433c06-446c-4001-b896-98b905c6c3cc\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:13.008142 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.008093    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:13.140226 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.140176    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"]
May 26 19:48:13.144265 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:48:13.144241    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64433c06_446c_4001_b896_98b905c6c3cc.slice/crio-c946b42bffee28809af512e9ad65ff0f5c6204e80efcdb0eae26aa29fb6dbec2 WatchSource:0}: Error finding container c946b42bffee28809af512e9ad65ff0f5c6204e80efcdb0eae26aa29fb6dbec2: Status 404 returned error can't find the container with id c946b42bffee28809af512e9ad65ff0f5c6204e80efcdb0eae26aa29fb6dbec2
May 26 19:48:13.546695 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.546655    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" event={"ID":"64433c06-446c-4001-b896-98b905c6c3cc","Type":"ContainerStarted","Data":"c946b42bffee28809af512e9ad65ff0f5c6204e80efcdb0eae26aa29fb6dbec2"}
May 26 19:48:13.547875 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.547849    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6" event={"ID":"9c5a66c3-45fd-4791-bc0f-f117fa646ef4","Type":"ContainerStarted","Data":"1821a61d684fb8321057f6f833e6f48bbbc8b90c3ab40e3eb12cdaa45dfbec61"}
May 26 19:48:13.548003 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.547984    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:13.567486 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:13.567389    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6" podStartSLOduration=2.370032808 podStartE2EDuration="4.567370959s" podCreationTimestamp="2026-05-26 19:48:09 +0000 UTC" firstStartedPulling="2026-05-26 19:48:10.409564568 +0000 UTC m=+464.888712190" lastFinishedPulling="2026-05-26 19:48:12.606902702 +0000 UTC m=+467.086050341" observedRunningTime="2026-05-26 19:48:13.567071791 +0000 UTC m=+468.046219437" watchObservedRunningTime="2026-05-26 19:48:13.567370959 +0000 UTC m=+468.046518604"
May 26 19:48:15.556476 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:15.556428    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" event={"ID":"64433c06-446c-4001-b896-98b905c6c3cc","Type":"ContainerStarted","Data":"1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36"}
May 26 19:48:15.556862 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:15.556500    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:15.575397 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:15.575343    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" podStartSLOduration=1.557230683 podStartE2EDuration="3.575327405s" podCreationTimestamp="2026-05-26 19:48:12 +0000 UTC" firstStartedPulling="2026-05-26 19:48:13.146343345 +0000 UTC m=+467.625490974" lastFinishedPulling="2026-05-26 19:48:15.16444007 +0000 UTC m=+469.643587696" observedRunningTime="2026-05-26 19:48:15.574144253 +0000 UTC m=+470.053291898" watchObservedRunningTime="2026-05-26 19:48:15.575327405 +0000 UTC m=+470.054475048"
May 26 19:48:24.553775 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:24.553741    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-svsg6"
May 26 19:48:26.562802 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:26.562767    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:35.826970 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.826933    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"]
May 26 19:48:35.830150 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.830128    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:35.834017 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.833995    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b8rpb\""
May 26 19:48:35.851088 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.851063    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"]
May 26 19:48:35.897267 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.897234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:35.897454 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.897284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrnzs\" (UniqueName: \"kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:35.998060 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.998018    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrnzs\" (UniqueName: \"kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:35.998243 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.998096    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:35.998448 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:35.998432    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:36.010580 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.010555    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrnzs\" (UniqueName: \"kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:36.139484 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.139399    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:36.277393 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.277359    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"]
May 26 19:48:36.280351 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:48:36.280306    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f4d3e0_1226_40a6_8871_fd2402a76e71.slice/crio-5b6031eb17cc97cc777b438a15f83929eca1d58c7736d5b7752f3d6ffc94fb89 WatchSource:0}: Error finding container 5b6031eb17cc97cc777b438a15f83929eca1d58c7736d5b7752f3d6ffc94fb89: Status 404 returned error can't find the container with id 5b6031eb17cc97cc777b438a15f83929eca1d58c7736d5b7752f3d6ffc94fb89
May 26 19:48:36.627434 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.627399    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9" event={"ID":"d0f4d3e0-1226-40a6-8871-fd2402a76e71","Type":"ContainerStarted","Data":"5b6031eb17cc97cc777b438a15f83929eca1d58c7736d5b7752f3d6ffc94fb89"}
May 26 19:48:36.718649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.718592    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"]
May 26 19:48:36.724822 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.724790    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"]
May 26 19:48:36.738335 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.738300    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"]
May 26 19:48:36.738652 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.738588    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" podUID="64433c06-446c-4001-b896-98b905c6c3cc" containerName="manager" containerID="cri-o://1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36" gracePeriod=2
May 26 19:48:36.744466 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.744427    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:48:36.749455 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.749429    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.763816 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.763784    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"]
May 26 19:48:36.766053 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.765558    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:48:36.804071 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.804032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.804245 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.804160    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62p8l\" (UniqueName: \"kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.904793 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.904754    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.905267 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.904887    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62p8l\" (UniqueName: \"kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.905336 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.905290    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:36.920621 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:36.920590    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62p8l\" (UniqueName: \"kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:37.033857 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.033795    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:37.036283 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.036239    2561 status_manager.go:895] "Failed to get status for pod" podUID="64433c06-446c-4001-b896-98b905c6c3cc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" err="pods \"limitador-operator-controller-manager-85c4996f8c-gbph7\" is forbidden: User \"system:node:ip-10-0-137-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-200.ec2.internal' and this object"
May 26 19:48:37.106674 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.106637    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkwk8\" (UniqueName: \"kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8\") pod \"64433c06-446c-4001-b896-98b905c6c3cc\" (UID: \"64433c06-446c-4001-b896-98b905c6c3cc\") "
May 26 19:48:37.110162 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.110124    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8" (OuterVolumeSpecName: "kube-api-access-kkwk8") pod "64433c06-446c-4001-b896-98b905c6c3cc" (UID: "64433c06-446c-4001-b896-98b905c6c3cc"). InnerVolumeSpecName "kube-api-access-kkwk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:48:37.127554 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.127511    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:37.208170 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.208108    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkwk8\" (UniqueName: \"kubernetes.io/projected/64433c06-446c-4001-b896-98b905c6c3cc-kube-api-access-kkwk8\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:48:37.473401 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.473376    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:48:37.475209 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:48:37.475182    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb6741f_d087_425b_8678_2664fd7bd70e.slice/crio-ffbee727a73205e70076d33d7e145e21c4efeee52970184b877fb59c64d8d060 WatchSource:0}: Error finding container ffbee727a73205e70076d33d7e145e21c4efeee52970184b877fb59c64d8d060: Status 404 returned error can't find the container with id ffbee727a73205e70076d33d7e145e21c4efeee52970184b877fb59c64d8d060
May 26 19:48:37.632512 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.632464    2561 generic.go:358] "Generic (PLEG): container finished" podID="64433c06-446c-4001-b896-98b905c6c3cc" containerID="1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36" exitCode=0
May 26 19:48:37.632704 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.632534    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7"
May 26 19:48:37.632704 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.632531    2561 scope.go:117] "RemoveContainer" containerID="1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36"
May 26 19:48:37.634170 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.634138    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" event={"ID":"5cb6741f-d087-425b-8678-2664fd7bd70e","Type":"ContainerStarted","Data":"ffbee727a73205e70076d33d7e145e21c4efeee52970184b877fb59c64d8d060"}
May 26 19:48:37.639079 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.639049    2561 status_manager.go:895] "Failed to get status for pod" podUID="64433c06-446c-4001-b896-98b905c6c3cc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" err="pods \"limitador-operator-controller-manager-85c4996f8c-gbph7\" is forbidden: User \"system:node:ip-10-0-137-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-200.ec2.internal' and this object"
May 26 19:48:37.643527 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.643505    2561 scope.go:117] "RemoveContainer" containerID="1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36"
May 26 19:48:37.643841 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:48:37.643816    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36\": container with ID starting with 1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36 not found: ID does not exist" containerID="1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36"
May 26 19:48:37.643974 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.643851    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36"} err="failed to get container status \"1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36\": rpc error: code = NotFound desc = could not find container \"1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36\": container with ID starting with 1d50494b80ffc8c1addf60bf4d4bc8697260e3f9f6d8bb9d79d0fe95fcbb8c36 not found: ID does not exist"
May 26 19:48:37.646485 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:37.646455    2561 status_manager.go:895] "Failed to get status for pod" podUID="64433c06-446c-4001-b896-98b905c6c3cc" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-gbph7" err="pods \"limitador-operator-controller-manager-85c4996f8c-gbph7\" is forbidden: User \"system:node:ip-10-0-137-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-200.ec2.internal' and this object"
May 26 19:48:38.133706 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:38.133665    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64433c06-446c-4001-b896-98b905c6c3cc" path="/var/lib/kubelet/pods/64433c06-446c-4001-b896-98b905c6c3cc/volumes"
May 26 19:48:41.652084 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.652042    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" event={"ID":"5cb6741f-d087-425b-8678-2664fd7bd70e","Type":"ContainerStarted","Data":"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"}
May 26 19:48:41.652526 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.652168    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:48:41.653619 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.653595    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" containerName="manager" containerID="cri-o://d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a" gracePeriod=2
May 26 19:48:41.673367 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.673322    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" podStartSLOduration=2.166098108 podStartE2EDuration="5.673308121s" podCreationTimestamp="2026-05-26 19:48:36 +0000 UTC" firstStartedPulling="2026-05-26 19:48:37.482099986 +0000 UTC m=+491.961247611" lastFinishedPulling="2026-05-26 19:48:40.989309989 +0000 UTC m=+495.468457624" observedRunningTime="2026-05-26 19:48:41.671252108 +0000 UTC m=+496.150399743" watchObservedRunningTime="2026-05-26 19:48:41.673308121 +0000 UTC m=+496.152455765"
May 26 19:48:41.891237 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.891213    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:41.893586 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.893563    2561 status_manager.go:895] "Failed to get status for pod" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" is forbidden: User \"system:node:ip-10-0-137-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-200.ec2.internal' and this object"
May 26 19:48:41.949273 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.949244    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume\") pod \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") "
May 26 19:48:41.949422 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.949281    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrnzs\" (UniqueName: \"kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs\") pod \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\" (UID: \"d0f4d3e0-1226-40a6-8871-fd2402a76e71\") "
May 26 19:48:41.949524 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.949498    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0f4d3e0-1226-40a6-8871-fd2402a76e71" (UID: "d0f4d3e0-1226-40a6-8871-fd2402a76e71"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:48:41.951476 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:41.951458    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs" (OuterVolumeSpecName: "kube-api-access-vrnzs") pod "d0f4d3e0-1226-40a6-8871-fd2402a76e71" (UID: "d0f4d3e0-1226-40a6-8871-fd2402a76e71"). InnerVolumeSpecName "kube-api-access-vrnzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:48:42.050842 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.050793    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0f4d3e0-1226-40a6-8871-fd2402a76e71-extensions-socket-volume\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:48:42.050842 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.050829    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrnzs\" (UniqueName: \"kubernetes.io/projected/d0f4d3e0-1226-40a6-8871-fd2402a76e71-kube-api-access-vrnzs\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:48:42.134638 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.134606    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" path="/var/lib/kubelet/pods/d0f4d3e0-1226-40a6-8871-fd2402a76e71/volumes"
May 26 19:48:42.657663 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.657622    2561 generic.go:358] "Generic (PLEG): container finished" podID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" containerID="d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a" exitCode=2
May 26 19:48:42.658125 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.657674    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9"
May 26 19:48:42.658125 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.657717    2561 scope.go:117] "RemoveContainer" containerID="d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a"
May 26 19:48:42.662487 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.662460    2561 status_manager.go:895] "Failed to get status for pod" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-f9vd9\" is forbidden: User \"system:node:ip-10-0-137-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-200.ec2.internal' and this object"
May 26 19:48:42.665413 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.665396    2561 scope.go:117] "RemoveContainer" containerID="d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a"
May 26 19:48:42.665678 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:48:42.665660    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a\": container with ID starting with d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a not found: ID does not exist" containerID="d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a"
May 26 19:48:42.665731 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:42.665687    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a"} err="failed to get container status \"d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a\": rpc error: code = NotFound desc = could not find container \"d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a\": container with ID starting with d6719b268a608f48709a6c00b22988f75d8d92caf0966d6b7e4776d8c1725c7a not found: ID does not exist"
May 26 19:48:52.660842 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:48:52.660810    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:49:05.082117 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.082031    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:49:05.082633 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.082314    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" podUID="5cb6741f-d087-425b-8678-2664fd7bd70e" containerName="manager" containerID="cri-o://ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636" gracePeriod=10
May 26 19:49:05.335141 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.335081    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:49:05.450320 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.450270    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62p8l\" (UniqueName: \"kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l\") pod \"5cb6741f-d087-425b-8678-2664fd7bd70e\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") "
May 26 19:49:05.450489 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.450337    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume\") pod \"5cb6741f-d087-425b-8678-2664fd7bd70e\" (UID: \"5cb6741f-d087-425b-8678-2664fd7bd70e\") "
May 26 19:49:05.450820 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.450787    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5cb6741f-d087-425b-8678-2664fd7bd70e" (UID: "5cb6741f-d087-425b-8678-2664fd7bd70e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:49:05.452554 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.452530    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l" (OuterVolumeSpecName: "kube-api-access-62p8l") pod "5cb6741f-d087-425b-8678-2664fd7bd70e" (UID: "5cb6741f-d087-425b-8678-2664fd7bd70e"). InnerVolumeSpecName "kube-api-access-62p8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:49:05.551339 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.551302    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62p8l\" (UniqueName: \"kubernetes.io/projected/5cb6741f-d087-425b-8678-2664fd7bd70e-kube-api-access-62p8l\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:49:05.551339 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.551332    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cb6741f-d087-425b-8678-2664fd7bd70e-extensions-socket-volume\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:49:05.735143 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.735108    2561 generic.go:358] "Generic (PLEG): container finished" podID="5cb6741f-d087-425b-8678-2664fd7bd70e" containerID="ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636" exitCode=0
May 26 19:49:05.735301 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.735174    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"
May 26 19:49:05.735301 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.735175    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" event={"ID":"5cb6741f-d087-425b-8678-2664fd7bd70e","Type":"ContainerDied","Data":"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"}
May 26 19:49:05.735301 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.735285    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4" event={"ID":"5cb6741f-d087-425b-8678-2664fd7bd70e","Type":"ContainerDied","Data":"ffbee727a73205e70076d33d7e145e21c4efeee52970184b877fb59c64d8d060"}
May 26 19:49:05.735465 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.735306    2561 scope.go:117] "RemoveContainer" containerID="ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"
May 26 19:49:05.743683 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.743665    2561 scope.go:117] "RemoveContainer" containerID="ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"
May 26 19:49:05.743944 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:49:05.743906    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636\": container with ID starting with ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636 not found: ID does not exist" containerID="ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"
May 26 19:49:05.744018 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.743951    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636"} err="failed to get container status \"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636\": rpc error: code = NotFound desc = could not find container \"ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636\": container with ID starting with ea99bd7eaeeed3103f751e834bd7e12a2d8db80334a2ce6c1085e7e908dcb636 not found: ID does not exist"
May 26 19:49:05.756774 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.756744    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:49:05.763055 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:05.763031    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-nqxx4"]
May 26 19:49:06.133383 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:06.133303    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb6741f-d087-425b-8678-2664fd7bd70e" path="/var/lib/kubelet/pods/5cb6741f-d087-425b-8678-2664fd7bd70e/volumes"
May 26 19:49:09.108955 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.108893    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"]
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109266    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64433c06-446c-4001-b896-98b905c6c3cc" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109281    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64433c06-446c-4001-b896-98b905c6c3cc" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109291    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109297    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109308    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb6741f-d087-425b-8678-2664fd7bd70e" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109317    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb6741f-d087-425b-8678-2664fd7bd70e" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109446    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0f4d3e0-1226-40a6-8871-fd2402a76e71" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109467    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="64433c06-446c-4001-b896-98b905c6c3cc" containerName="manager"
May 26 19:49:09.109502 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.109480    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="5cb6741f-d087-425b-8678-2664fd7bd70e" containerName="manager"
May 26 19:49:09.114935 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.114889    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.117657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.117627    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kgbzn\""
May 26 19:49:09.124638 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.124603    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"]
May 26 19:49:09.283556 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283511    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283556 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283563    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr666\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-kube-api-access-gr666\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283807 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283639    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283807 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283807 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a5f0963-bfb3-419b-be88-3b267e4e313b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283971 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283971 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283828    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283971 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.283971 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.283884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385011 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.384888    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385011 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.384961    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385011 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.384989    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385298 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385020    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385298 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385089    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385398 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385322    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385465 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385445    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr666\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-kube-api-access-gr666\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385534 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385508    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385588 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385518    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385642 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385620    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.385699 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385629    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.386069 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.385815    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.386069 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.386046    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a5f0963-bfb3-419b-be88-3b267e4e313b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.386689 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.386666    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a5f0963-bfb3-419b-be88-3b267e4e313b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.387757 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.387728    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.387945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.387903    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.394671 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.394646    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr666\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-kube-api-access-gr666\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.395583 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.395561    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a5f0963-bfb3-419b-be88-3b267e4e313b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-p2pgt\" (UID: \"7a5f0963-bfb3-419b-be88-3b267e4e313b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.427971 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.427891    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:09.561865 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.561832    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"]
May 26 19:49:09.565736 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:09.565695    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5f0963_bfb3_419b_be88_3b267e4e313b.slice/crio-5083d0f5aafc8dccece4466fcea677d44bf94cbf9cd206757a966eddc2eaa4fb WatchSource:0}: Error finding container 5083d0f5aafc8dccece4466fcea677d44bf94cbf9cd206757a966eddc2eaa4fb: Status 404 returned error can't find the container with id 5083d0f5aafc8dccece4466fcea677d44bf94cbf9cd206757a966eddc2eaa4fb
May 26 19:49:09.751470 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:09.751436    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt" event={"ID":"7a5f0963-bfb3-419b-be88-3b267e4e313b","Type":"ContainerStarted","Data":"5083d0f5aafc8dccece4466fcea677d44bf94cbf9cd206757a966eddc2eaa4fb"}
May 26 19:49:12.093342 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:12.093288    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
May 26 19:49:12.093600 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:12.093385    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
May 26 19:49:12.093600 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:12.093414    2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
May 26 19:49:12.769209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:12.769149    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt" event={"ID":"7a5f0963-bfb3-419b-be88-3b267e4e313b","Type":"ContainerStarted","Data":"e1782c2fd3e4ba0c60ac70bced884154476e9b71382ee9bac6b5f3a7f0ab1401"}
May 26 19:49:12.790777 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:12.790729    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt" podStartSLOduration=1.265277153 podStartE2EDuration="3.790715289s" podCreationTimestamp="2026-05-26 19:49:09 +0000 UTC" firstStartedPulling="2026-05-26 19:49:09.567548952 +0000 UTC m=+524.046696573" lastFinishedPulling="2026-05-26 19:49:12.092987079 +0000 UTC m=+526.572134709" observedRunningTime="2026-05-26 19:49:12.788530611 +0000 UTC m=+527.267678254" watchObservedRunningTime="2026-05-26 19:49:12.790715289 +0000 UTC m=+527.269862932"
May 26 19:49:13.428083 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:13.428003    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:13.434162 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:13.434133    2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:13.773417 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:13.773385    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:13.774543 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:13.774523    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-p2pgt"
May 26 19:49:23.807763 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.807723    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:23.810681 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.810660    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:23.813279 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.813256    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gs6mz\""
May 26 19:49:23.813383 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.813301    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 26 19:49:23.818119 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.818097    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:23.902541 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.902509    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:23.905319 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.905293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:23.905393 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:23.905339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgnp\" (UniqueName: \"kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.006006 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.005970    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.006006 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.006007    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgnp\" (UniqueName: \"kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.006589 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.006566    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.014799 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.014768    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgnp\" (UniqueName: \"kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp\") pod \"limitador-limitador-7d549b5b-p94pc\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") " pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.121529 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.121430    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:24.222608 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.222514    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:49:24.225377 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.225353    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.236233 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.233966    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:49:24.248261 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.248234    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:49:24.251825 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.251797    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:24.254754 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:24.254727    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab244167_0406_4f36_b673_5861242c4285.slice/crio-2258a325dbfb61b1470a76588edc1b90379c87a38dfb430f1bcf0a27a01e4b31 WatchSource:0}: Error finding container 2258a325dbfb61b1470a76588edc1b90379c87a38dfb430f1bcf0a27a01e4b31: Status 404 returned error can't find the container with id 2258a325dbfb61b1470a76588edc1b90379c87a38dfb430f1bcf0a27a01e4b31
May 26 19:49:24.308386 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.308341    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmgx\" (UniqueName: \"kubernetes.io/projected/54e56494-0ae5-4548-8da9-46c3bf5260db-kube-api-access-jfmgx\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.308386 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.308382    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54e56494-0ae5-4548-8da9-46c3bf5260db-config-file\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.409482 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.409377    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmgx\" (UniqueName: \"kubernetes.io/projected/54e56494-0ae5-4548-8da9-46c3bf5260db-kube-api-access-jfmgx\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.409482 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.409428    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54e56494-0ae5-4548-8da9-46c3bf5260db-config-file\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.410102 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.410077    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/54e56494-0ae5-4548-8da9-46c3bf5260db-config-file\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.420728 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.420698    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmgx\" (UniqueName: \"kubernetes.io/projected/54e56494-0ae5-4548-8da9-46c3bf5260db-kube-api-access-jfmgx\") pod \"limitador-limitador-78c99df468-jvw6h\" (UID: \"54e56494-0ae5-4548-8da9-46c3bf5260db\") " pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.543987 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.543945    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:24.681649 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.681497    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:49:24.684013 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:24.683986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e56494_0ae5_4548_8da9_46c3bf5260db.slice/crio-3692ae8050b9258ef9ecc6c4af0981c4ce27bdd3b40dc3a26f302e46b1d056f9 WatchSource:0}: Error finding container 3692ae8050b9258ef9ecc6c4af0981c4ce27bdd3b40dc3a26f302e46b1d056f9: Status 404 returned error can't find the container with id 3692ae8050b9258ef9ecc6c4af0981c4ce27bdd3b40dc3a26f302e46b1d056f9
May 26 19:49:24.811077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.811045    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h" event={"ID":"54e56494-0ae5-4548-8da9-46c3bf5260db","Type":"ContainerStarted","Data":"3692ae8050b9258ef9ecc6c4af0981c4ce27bdd3b40dc3a26f302e46b1d056f9"}
May 26 19:49:24.811993 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:24.811972    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" event={"ID":"ab244167-0406-4f36-b673-5861242c4285","Type":"ContainerStarted","Data":"2258a325dbfb61b1470a76588edc1b90379c87a38dfb430f1bcf0a27a01e4b31"}
May 26 19:49:27.824281 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.824245    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" event={"ID":"ab244167-0406-4f36-b673-5861242c4285","Type":"ContainerStarted","Data":"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"}
May 26 19:49:27.824709 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.824379    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:27.825566 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.825544    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h" event={"ID":"54e56494-0ae5-4548-8da9-46c3bf5260db","Type":"ContainerStarted","Data":"2b6e3fce4b370ab73707ed352fe8378d180362d9ee2785c5d2cd82997c26bf52"}
May 26 19:49:27.825704 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.825692    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:27.844296 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.844252    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" podStartSLOduration=1.839956451 podStartE2EDuration="4.844240458s" podCreationTimestamp="2026-05-26 19:49:23 +0000 UTC" firstStartedPulling="2026-05-26 19:49:24.256478481 +0000 UTC m=+538.735626102" lastFinishedPulling="2026-05-26 19:49:27.260762479 +0000 UTC m=+541.739910109" observedRunningTime="2026-05-26 19:49:27.843475743 +0000 UTC m=+542.322623388" watchObservedRunningTime="2026-05-26 19:49:27.844240458 +0000 UTC m=+542.323388101"
May 26 19:49:27.859491 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:27.859445    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h" podStartSLOduration=1.277354727 podStartE2EDuration="3.859430307s" podCreationTimestamp="2026-05-26 19:49:24 +0000 UTC" firstStartedPulling="2026-05-26 19:49:24.685736115 +0000 UTC m=+539.164883737" lastFinishedPulling="2026-05-26 19:49:27.267811692 +0000 UTC m=+541.746959317" observedRunningTime="2026-05-26 19:49:27.858618828 +0000 UTC m=+542.337766481" watchObservedRunningTime="2026-05-26 19:49:27.859430307 +0000 UTC m=+542.338578001"
May 26 19:49:38.830592 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:38.830562    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-jvw6h"
May 26 19:49:38.831045 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:38.830622    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:38.889294 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:38.889255    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:38.889490 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:38.889466    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" podUID="ab244167-0406-4f36-b673-5861242c4285" containerName="limitador" containerID="cri-o://b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f" gracePeriod=30
May 26 19:49:39.449646 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.449592    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:39.538575 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.538534    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file\") pod \"ab244167-0406-4f36-b673-5861242c4285\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") "
May 26 19:49:39.538719 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.538637    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwgnp\" (UniqueName: \"kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp\") pod \"ab244167-0406-4f36-b673-5861242c4285\" (UID: \"ab244167-0406-4f36-b673-5861242c4285\") "
May 26 19:49:39.538953 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.538894    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file" (OuterVolumeSpecName: "config-file") pod "ab244167-0406-4f36-b673-5861242c4285" (UID: "ab244167-0406-4f36-b673-5861242c4285"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:49:39.540764 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.540742    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp" (OuterVolumeSpecName: "kube-api-access-zwgnp") pod "ab244167-0406-4f36-b673-5861242c4285" (UID: "ab244167-0406-4f36-b673-5861242c4285"). InnerVolumeSpecName "kube-api-access-zwgnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:49:39.639339 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.639304    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwgnp\" (UniqueName: \"kubernetes.io/projected/ab244167-0406-4f36-b673-5861242c4285-kube-api-access-zwgnp\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:49:39.639339 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.639334    2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab244167-0406-4f36-b673-5861242c4285-config-file\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:49:39.864726 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.864638    2561 generic.go:358] "Generic (PLEG): container finished" podID="ab244167-0406-4f36-b673-5861242c4285" containerID="b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f" exitCode=0
May 26 19:49:39.864726 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.864703    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc"
May 26 19:49:39.865209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.864723    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" event={"ID":"ab244167-0406-4f36-b673-5861242c4285","Type":"ContainerDied","Data":"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"}
May 26 19:49:39.865209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.864766    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-p94pc" event={"ID":"ab244167-0406-4f36-b673-5861242c4285","Type":"ContainerDied","Data":"2258a325dbfb61b1470a76588edc1b90379c87a38dfb430f1bcf0a27a01e4b31"}
May 26 19:49:39.865209 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.864781    2561 scope.go:117] "RemoveContainer" containerID="b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"
May 26 19:49:39.873116 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.873101    2561 scope.go:117] "RemoveContainer" containerID="b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"
May 26 19:49:39.873367 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:49:39.873348    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f\": container with ID starting with b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f not found: ID does not exist" containerID="b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"
May 26 19:49:39.873435 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.873372    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f"} err="failed to get container status \"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f\": rpc error: code = NotFound desc = could not find container \"b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f\": container with ID starting with b3252eac4a01f464b5d3922f267a8b714fbaf28896192d1c8947979f6657858f not found: ID does not exist"
May 26 19:49:39.886113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.886087    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:39.890081 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:39.890054    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-p94pc"]
May 26 19:49:40.057068 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.057035    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t99ns"]
May 26 19:49:40.057391 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.057377    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab244167-0406-4f36-b673-5861242c4285" containerName="limitador"
May 26 19:49:40.057391 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.057392    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab244167-0406-4f36-b673-5861242c4285" containerName="limitador"
May 26 19:49:40.057469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.057458    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab244167-0406-4f36-b673-5861242c4285" containerName="limitador"
May 26 19:49:40.061569 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.061542    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.064083 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.064058    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 26 19:49:40.064251 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.064058    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rb8nr\""
May 26 19:49:40.066923 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.066888    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t99ns"]
May 26 19:49:40.133536 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.133449    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab244167-0406-4f36-b673-5861242c4285" path="/var/lib/kubelet/pods/ab244167-0406-4f36-b673-5861242c4285/volumes"
May 26 19:49:40.143541 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.143506    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnh9m\" (UniqueName: \"kubernetes.io/projected/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-kube-api-access-gnh9m\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.143702 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.143556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-data\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.244590 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.244561    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnh9m\" (UniqueName: \"kubernetes.io/projected/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-kube-api-access-gnh9m\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.244809 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.244606    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-data\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.244960 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.244942    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-data\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.253003 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.252981    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnh9m\" (UniqueName: \"kubernetes.io/projected/2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b-kube-api-access-gnh9m\") pod \"postgres-68c4fbbd6f-t99ns\" (UID: \"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b\") " pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.372852 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.372816    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:40.500506 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.500477    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-t99ns"]
May 26 19:49:40.502866 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:40.502836    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f23e7e6_ef7c_4e4e_929f_254f7c23bb1b.slice/crio-ddc128724bab11790c0bfeb15ce40354b0f7673da637b1d1ff2063f17b8939be WatchSource:0}: Error finding container ddc128724bab11790c0bfeb15ce40354b0f7673da637b1d1ff2063f17b8939be: Status 404 returned error can't find the container with id ddc128724bab11790c0bfeb15ce40354b0f7673da637b1d1ff2063f17b8939be
May 26 19:49:40.869112 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:40.869072    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t99ns" event={"ID":"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b","Type":"ContainerStarted","Data":"ddc128724bab11790c0bfeb15ce40354b0f7673da637b1d1ff2063f17b8939be"}
May 26 19:49:45.890767 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:45.890734    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-t99ns" event={"ID":"2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b","Type":"ContainerStarted","Data":"0e54095131d7059ce7bb8a0d19d2324db0172081ae4244dbabf3bb2f6850002c"}
May 26 19:49:45.891158 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:45.890784    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:45.908003 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:45.907956    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-t99ns" podStartSLOduration=0.646879847 podStartE2EDuration="5.9079428s" podCreationTimestamp="2026-05-26 19:49:40 +0000 UTC" firstStartedPulling="2026-05-26 19:49:40.50413684 +0000 UTC m=+554.983284461" lastFinishedPulling="2026-05-26 19:49:45.765199789 +0000 UTC m=+560.244347414" observedRunningTime="2026-05-26 19:49:45.906052601 +0000 UTC m=+560.385200241" watchObservedRunningTime="2026-05-26 19:49:45.9079428 +0000 UTC m=+560.387090445"
May 26 19:49:51.922125 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:51.922095    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-t99ns"
May 26 19:49:58.667720 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.667688    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:49:58.671185 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.671169    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:49:58.674051 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.674031    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 19:49:58.674051 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.674048    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lthlv\""
May 26 19:49:58.681315 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.681293    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:49:58.806822 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.806783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ttm4\" (UniqueName: \"kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4\") pod \"maas-controller-69d7d46cbf-zr7r2\" (UID: \"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046\") " pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:49:58.871507 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.871473    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:49:58.874954 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.874933    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:49:58.885266 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.885229    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:49:58.907955 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.907896    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ttm4\" (UniqueName: \"kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4\") pod \"maas-controller-69d7d46cbf-zr7r2\" (UID: \"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046\") " pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:49:58.916906 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.916884    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ttm4\" (UniqueName: \"kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4\") pod \"maas-controller-69d7d46cbf-zr7r2\" (UID: \"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046\") " pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:49:58.981984 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:58.981949    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:49:59.009003 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.008971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-944rw\" (UniqueName: \"kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw\") pod \"maas-controller-59dfbf9bc5-ll8ns\" (UID: \"cb17979d-1ba2-4295-8495-d5eb093b2964\") " pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:49:59.109607 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.109570    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-944rw\" (UniqueName: \"kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw\") pod \"maas-controller-59dfbf9bc5-ll8ns\" (UID: \"cb17979d-1ba2-4295-8495-d5eb093b2964\") " pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:49:59.110382 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.110362    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:49:59.113040 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:59.113011    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853ccb91_c8e6_4ef6_8e3a_4c07d7b5b046.slice/crio-fdd5edfc2b2ce5b3f0437055c49c79e3ba4161c07976b3c64dc9662d190db629 WatchSource:0}: Error finding container fdd5edfc2b2ce5b3f0437055c49c79e3ba4161c07976b3c64dc9662d190db629: Status 404 returned error can't find the container with id fdd5edfc2b2ce5b3f0437055c49c79e3ba4161c07976b3c64dc9662d190db629
May 26 19:49:59.118462 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.118443    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-944rw\" (UniqueName: \"kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw\") pod \"maas-controller-59dfbf9bc5-ll8ns\" (UID: \"cb17979d-1ba2-4295-8495-d5eb093b2964\") " pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:49:59.185463 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.185424    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:49:59.310012 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.309869    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:49:59.311955 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:49:59.311927    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb17979d_1ba2_4295_8495_d5eb093b2964.slice/crio-dd32afb23cdc1d2b07a9fed0563af0d6894b71b6dc50b1e4cb8b58c4a56b533d WatchSource:0}: Error finding container dd32afb23cdc1d2b07a9fed0563af0d6894b71b6dc50b1e4cb8b58c4a56b533d: Status 404 returned error can't find the container with id dd32afb23cdc1d2b07a9fed0563af0d6894b71b6dc50b1e4cb8b58c4a56b533d
May 26 19:49:59.941204 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.941143    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" event={"ID":"cb17979d-1ba2-4295-8495-d5eb093b2964","Type":"ContainerStarted","Data":"dd32afb23cdc1d2b07a9fed0563af0d6894b71b6dc50b1e4cb8b58c4a56b533d"}
May 26 19:49:59.943085 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:49:59.943055    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" event={"ID":"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046","Type":"ContainerStarted","Data":"fdd5edfc2b2ce5b3f0437055c49c79e3ba4161c07976b3c64dc9662d190db629"}
May 26 19:50:01.952216 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.952183    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" event={"ID":"cb17979d-1ba2-4295-8495-d5eb093b2964","Type":"ContainerStarted","Data":"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"}
May 26 19:50:01.952657 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.952312    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:50:01.953656 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.953629    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" event={"ID":"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046","Type":"ContainerStarted","Data":"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"}
May 26 19:50:01.953778 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.953712    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:50:01.974587 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.974542    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" podStartSLOduration=1.641949222 podStartE2EDuration="3.974528413s" podCreationTimestamp="2026-05-26 19:49:58 +0000 UTC" firstStartedPulling="2026-05-26 19:49:59.313262743 +0000 UTC m=+573.792410364" lastFinishedPulling="2026-05-26 19:50:01.645841921 +0000 UTC m=+576.124989555" observedRunningTime="2026-05-26 19:50:01.974015083 +0000 UTC m=+576.453162726" watchObservedRunningTime="2026-05-26 19:50:01.974528413 +0000 UTC m=+576.453676055"
May 26 19:50:01.993529 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:01.993483    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" podStartSLOduration=1.471491303 podStartE2EDuration="3.993468765s" podCreationTimestamp="2026-05-26 19:49:58 +0000 UTC" firstStartedPulling="2026-05-26 19:49:59.114290071 +0000 UTC m=+573.593437694" lastFinishedPulling="2026-05-26 19:50:01.636267535 +0000 UTC m=+576.115415156" observedRunningTime="2026-05-26 19:50:01.991897401 +0000 UTC m=+576.471045057" watchObservedRunningTime="2026-05-26 19:50:01.993468765 +0000 UTC m=+576.472616407"
May 26 19:50:12.962326 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:12.962296    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:50:12.962779 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:12.962350    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:50:13.020210 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.020174    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:50:13.020375 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.020355    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" podUID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" containerName="manager" containerID="cri-o://6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245" gracePeriod=30
May 26 19:50:13.267820 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.267797    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:50:13.433733 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.433703    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ttm4\" (UniqueName: \"kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4\") pod \"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046\" (UID: \"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046\") "
May 26 19:50:13.435966 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.435939    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4" (OuterVolumeSpecName: "kube-api-access-4ttm4") pod "853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" (UID: "853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046"). InnerVolumeSpecName "kube-api-access-4ttm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:50:13.534947 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.534811    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ttm4\" (UniqueName: \"kubernetes.io/projected/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046-kube-api-access-4ttm4\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:50:13.993878 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.993841    2561 generic.go:358] "Generic (PLEG): container finished" podID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" containerID="6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245" exitCode=0
May 26 19:50:13.994294 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.993900    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2"
May 26 19:50:13.994294 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.993949    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" event={"ID":"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046","Type":"ContainerDied","Data":"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"}
May 26 19:50:13.994294 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.993989    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69d7d46cbf-zr7r2" event={"ID":"853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046","Type":"ContainerDied","Data":"fdd5edfc2b2ce5b3f0437055c49c79e3ba4161c07976b3c64dc9662d190db629"}
May 26 19:50:13.994294 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:13.994004    2561 scope.go:117] "RemoveContainer" containerID="6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"
May 26 19:50:14.005038 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:14.005018    2561 scope.go:117] "RemoveContainer" containerID="6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"
May 26 19:50:14.005287 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:50:14.005270    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245\": container with ID starting with 6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245 not found: ID does not exist" containerID="6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"
May 26 19:50:14.005352 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:14.005295    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245"} err="failed to get container status \"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245\": rpc error: code = NotFound desc = could not find container \"6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245\": container with ID starting with 6f67e79200f4485fca193d7d3801947b5ae4626a1f38aae2019fdb974fe94245 not found: ID does not exist"
May 26 19:50:14.015824 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:14.015801    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:50:14.020368 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:14.020346    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69d7d46cbf-zr7r2"]
May 26 19:50:14.132262 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:14.132231    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" path="/var/lib/kubelet/pods/853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046/volumes"
May 26 19:50:33.171307 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.171273    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"]
May 26 19:50:33.171663 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.171568    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" containerName="manager"
May 26 19:50:33.171663 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.171578    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" containerName="manager"
May 26 19:50:33.171663 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.171634    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="853ccb91-c8e6-4ef6-8e3a-4c07d7b5b046" containerName="manager"
May 26 19:50:33.191298 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.191268    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"]
May 26 19:50:33.191469 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.191386    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:33.194163 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.194135    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 26 19:50:33.289974 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.289933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd64j\" (UniqueName: \"kubernetes.io/projected/f0cb6404-ce95-4fa7-8973-20e5a9d66bce-kube-api-access-bd64j\") pod \"payload-processing-58b6c8fdc7-gdjzk\" (UID: \"f0cb6404-ce95-4fa7-8973-20e5a9d66bce\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:33.390682 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.390640    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bd64j\" (UniqueName: \"kubernetes.io/projected/f0cb6404-ce95-4fa7-8973-20e5a9d66bce-kube-api-access-bd64j\") pod \"payload-processing-58b6c8fdc7-gdjzk\" (UID: \"f0cb6404-ce95-4fa7-8973-20e5a9d66bce\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:33.398853 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.398825    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd64j\" (UniqueName: \"kubernetes.io/projected/f0cb6404-ce95-4fa7-8973-20e5a9d66bce-kube-api-access-bd64j\") pod \"payload-processing-58b6c8fdc7-gdjzk\" (UID: \"f0cb6404-ce95-4fa7-8973-20e5a9d66bce\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:33.425282 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.425217    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:50:33.501485 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.501449    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:33.643356 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:33.643261    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"]
May 26 19:50:33.646368 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:50:33.646338    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cb6404_ce95_4fa7_8973_20e5a9d66bce.slice/crio-09d05386ef19ce3cd8cb4c60cfaf47d234a7225d3ecdf02aa346461b08f64c02 WatchSource:0}: Error finding container 09d05386ef19ce3cd8cb4c60cfaf47d234a7225d3ecdf02aa346461b08f64c02: Status 404 returned error can't find the container with id 09d05386ef19ce3cd8cb4c60cfaf47d234a7225d3ecdf02aa346461b08f64c02
May 26 19:50:34.059865 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:34.059831    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk" event={"ID":"f0cb6404-ce95-4fa7-8973-20e5a9d66bce","Type":"ContainerStarted","Data":"09d05386ef19ce3cd8cb4c60cfaf47d234a7225d3ecdf02aa346461b08f64c02"}
May 26 19:50:36.068748 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:36.068701    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk" event={"ID":"f0cb6404-ce95-4fa7-8973-20e5a9d66bce","Type":"ContainerStarted","Data":"a253d43d42122e32e48b548fe64f74ba903a195bebffa3245563d9c3d37823e5"}
May 26 19:50:36.069322 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:36.068824    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:36.086117 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:36.086030    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk" podStartSLOduration=1.639333872 podStartE2EDuration="3.086012567s" podCreationTimestamp="2026-05-26 19:50:33 +0000 UTC" firstStartedPulling="2026-05-26 19:50:33.648035477 +0000 UTC m=+608.127183111" lastFinishedPulling="2026-05-26 19:50:35.094714175 +0000 UTC m=+609.573861806" observedRunningTime="2026-05-26 19:50:36.084219099 +0000 UTC m=+610.563366755" watchObservedRunningTime="2026-05-26 19:50:36.086012567 +0000 UTC m=+610.565160212"
May 26 19:50:45.680334 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.680292    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"]
May 26 19:50:45.684077 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.684053    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.688020 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.687998    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r7z6f\""
May 26 19:50:45.688153 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.688040    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 19:50:45.688153 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.688064    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 26 19:50:45.688153 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.688040    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 19:50:45.694778 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.694757    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"]
May 26 19:50:45.803353 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2549fb-eed7-4df9-9aef-9d2c72697796-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.803522 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.803522 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.803522 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.803522 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803492    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhlh\" (UniqueName: \"kubernetes.io/projected/ed2549fb-eed7-4df9-9aef-9d2c72697796-kube-api-access-jmhlh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.803522 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.803516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904484 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904446    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904678 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904493    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904678 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904524    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhlh\" (UniqueName: \"kubernetes.io/projected/ed2549fb-eed7-4df9-9aef-9d2c72697796-kube-api-access-jmhlh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904678 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904549    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904678 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904575    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2549fb-eed7-4df9-9aef-9d2c72697796-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904678 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904602    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904950    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.904981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904972    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.905060 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.904997    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.906956 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.906934    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2549fb-eed7-4df9-9aef-9d2c72697796-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.907303 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.907286    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2549fb-eed7-4df9-9aef-9d2c72697796-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.918440 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.918415    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhlh\" (UniqueName: \"kubernetes.io/projected/ed2549fb-eed7-4df9-9aef-9d2c72697796-kube-api-access-jmhlh\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4\" (UID: \"ed2549fb-eed7-4df9-9aef-9d2c72697796\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:45.994484 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:45.994445    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:50:46.123184 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:46.123143    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"]
May 26 19:50:46.127719 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:50:46.127686    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2549fb_eed7_4df9_9aef_9d2c72697796.slice/crio-d22f7523afd78814816c37d922092945d98d111cf17a75dc56c7e31717c7576a WatchSource:0}: Error finding container d22f7523afd78814816c37d922092945d98d111cf17a75dc56c7e31717c7576a: Status 404 returned error can't find the container with id d22f7523afd78814816c37d922092945d98d111cf17a75dc56c7e31717c7576a
May 26 19:50:46.129480 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:46.129463    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:50:46.196135 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:46.196100    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:50:47.075152 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:47.075118    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-gdjzk"
May 26 19:50:47.109195 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:47.109161    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4" event={"ID":"ed2549fb-eed7-4df9-9aef-9d2c72697796","Type":"ContainerStarted","Data":"d22f7523afd78814816c37d922092945d98d111cf17a75dc56c7e31717c7576a"}
May 26 19:50:54.137624 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:54.137591    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4" event={"ID":"ed2549fb-eed7-4df9-9aef-9d2c72697796","Type":"ContainerStarted","Data":"2facbc55cf32d1454a01bd84f865af17301087c3c2455716b5509feadc195d0b"}
May 26 19:50:59.156197 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:59.156113    2561 generic.go:358] "Generic (PLEG): container finished" podID="ed2549fb-eed7-4df9-9aef-9d2c72697796" containerID="2facbc55cf32d1454a01bd84f865af17301087c3c2455716b5509feadc195d0b" exitCode=0
May 26 19:50:59.156197 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:59.156160    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4" event={"ID":"ed2549fb-eed7-4df9-9aef-9d2c72697796","Type":"ContainerDied","Data":"2facbc55cf32d1454a01bd84f865af17301087c3c2455716b5509feadc195d0b"}
May 26 19:50:59.787933 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:50:59.787871    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:51:01.164387 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:01.164352    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4" event={"ID":"ed2549fb-eed7-4df9-9aef-9d2c72697796","Type":"ContainerStarted","Data":"01e9432873801a2bd7a7321ccf79ad7158bc37750d03f0cf5e10cd8a63fbb553"}
May 26 19:51:01.164763 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:01.164554    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:51:01.185501 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:01.185450    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4" podStartSLOduration=1.9485759150000002 podStartE2EDuration="16.185437893s" podCreationTimestamp="2026-05-26 19:50:45 +0000 UTC" firstStartedPulling="2026-05-26 19:50:46.129603632 +0000 UTC m=+620.608751253" lastFinishedPulling="2026-05-26 19:51:00.366465606 +0000 UTC m=+634.845613231" observedRunningTime="2026-05-26 19:51:01.183264363 +0000 UTC m=+635.662411999" watchObservedRunningTime="2026-05-26 19:51:01.185437893 +0000 UTC m=+635.664585536"
May 26 19:51:06.766166 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.766128    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"]
May 26 19:51:06.769371 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.769346    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.771873 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.771848    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 26 19:51:06.779503 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.779482    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"]
May 26 19:51:06.797808 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.797776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.797808 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.797808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.798032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.797830    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.798032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.797951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.798032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.797981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2864s\" (UniqueName: \"kubernetes.io/projected/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kube-api-access-2864s\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.798032 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.798011    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.898703 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898673    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.898891 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898713    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2864s\" (UniqueName: \"kubernetes.io/projected/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kube-api-access-2864s\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.898891 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898740    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.898891 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898785    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.898891 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898879    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.899172 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.898953    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.899231 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.899211    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.899337 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.899311    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.899390 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.899376    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.901263 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.901241    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.901444 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.901424    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:06.907249 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:06.907214    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2864s\" (UniqueName: \"kubernetes.io/projected/29f36d0a-699e-4c7d-8953-b6f5f34ccdb3-kube-api-access-2864s\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-g92nz\" (UID: \"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:07.079516 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:07.079426    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:07.229095 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:07.229066    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"]
May 26 19:51:07.232099 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:51:07.231959    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f36d0a_699e_4c7d_8953_b6f5f34ccdb3.slice/crio-730aeb804c95ad49b5cca8ee56321454a82ec69ff423612cf780c11b1bb447ea WatchSource:0}: Error finding container 730aeb804c95ad49b5cca8ee56321454a82ec69ff423612cf780c11b1bb447ea: Status 404 returned error can't find the container with id 730aeb804c95ad49b5cca8ee56321454a82ec69ff423612cf780c11b1bb447ea
May 26 19:51:07.495479 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:07.495428    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:51:08.191825 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:08.191790    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz" event={"ID":"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3","Type":"ContainerStarted","Data":"aa685b98a6de6bb3d6274cf4ae434ee4f30dd7a68856f397c705c94f17061eb2"}
May 26 19:51:08.191825 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:08.191823    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz" event={"ID":"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3","Type":"ContainerStarted","Data":"730aeb804c95ad49b5cca8ee56321454a82ec69ff423612cf780c11b1bb447ea"}
May 26 19:51:12.182554 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:12.182521    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4"
May 26 19:51:15.494113 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:15.494078    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:51:16.225981 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:16.225948    2561 generic.go:358] "Generic (PLEG): container finished" podID="29f36d0a-699e-4c7d-8953-b6f5f34ccdb3" containerID="aa685b98a6de6bb3d6274cf4ae434ee4f30dd7a68856f397c705c94f17061eb2" exitCode=0
May 26 19:51:16.226180 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:16.226021    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz" event={"ID":"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3","Type":"ContainerDied","Data":"aa685b98a6de6bb3d6274cf4ae434ee4f30dd7a68856f397c705c94f17061eb2"}
May 26 19:51:17.231510 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:17.231477    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz" event={"ID":"29f36d0a-699e-4c7d-8953-b6f5f34ccdb3","Type":"ContainerStarted","Data":"e498ac141f6a952ff394e9c91d2a15835da4f5f32cb0e6110466621a01408674"}
May 26 19:51:17.231970 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:17.231663    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:17.251218 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:17.251169    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz" podStartSLOduration=11.017574399 podStartE2EDuration="11.251155964s" podCreationTimestamp="2026-05-26 19:51:06 +0000 UTC" firstStartedPulling="2026-05-26 19:51:16.226623839 +0000 UTC m=+650.705771460" lastFinishedPulling="2026-05-26 19:51:16.460205401 +0000 UTC m=+650.939353025" observedRunningTime="2026-05-26 19:51:17.249236747 +0000 UTC m=+651.728384382" watchObservedRunningTime="2026-05-26 19:51:17.251155964 +0000 UTC m=+651.730303607"
May 26 19:51:20.798243 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:20.798212    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:51:28.247553 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:28.247521    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-g92nz"
May 26 19:51:35.873602 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.873558    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"]
May 26 19:51:35.876902 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.876883    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.879471 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.879445    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 26 19:51:35.886941 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.886897    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"]
May 26 19:51:35.940332 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00592eb2-f163-45cc-9b8d-8d63156eb590-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.940497 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqcj\" (UniqueName: \"kubernetes.io/projected/00592eb2-f163-45cc-9b8d-8d63156eb590-kube-api-access-fxqcj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.940497 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940425    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.940497 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.940497 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940486    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:35.940652 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:35.940588    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.041957 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.041892    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042140 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.041999    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00592eb2-f163-45cc-9b8d-8d63156eb590-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042140 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042028    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqcj\" (UniqueName: \"kubernetes.io/projected/00592eb2-f163-45cc-9b8d-8d63156eb590-kube-api-access-fxqcj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042218 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042167    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042218 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042205    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042292 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042223    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042554 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042526    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042581    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.042740 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.042606    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.044370 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.044349    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00592eb2-f163-45cc-9b8d-8d63156eb590-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.044542 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.044523    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00592eb2-f163-45cc-9b8d-8d63156eb590-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.055287 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.055253    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqcj\" (UniqueName: \"kubernetes.io/projected/00592eb2-f163-45cc-9b8d-8d63156eb590-kube-api-access-fxqcj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq\" (UID: \"00592eb2-f163-45cc-9b8d-8d63156eb590\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.189696 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.189650    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:36.331743 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.331587    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"]
May 26 19:51:36.335122 ip-10-0-137-200 kubenswrapper[2561]: W0526 19:51:36.335095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00592eb2_f163_45cc_9b8d_8d63156eb590.slice/crio-4e60f74d3f01254e6b33a6d791b150a74a28e7b4d648079de87172d4f713b03c WatchSource:0}: Error finding container 4e60f74d3f01254e6b33a6d791b150a74a28e7b4d648079de87172d4f713b03c: Status 404 returned error can't find the container with id 4e60f74d3f01254e6b33a6d791b150a74a28e7b4d648079de87172d4f713b03c
May 26 19:51:36.904745 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:36.904707    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:51:37.305123 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:37.305082    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq" event={"ID":"00592eb2-f163-45cc-9b8d-8d63156eb590","Type":"ContainerStarted","Data":"fa118aa7db57c04a9531ff3e6c61687b6193da985310b0054e8528b3b912c726"}
May 26 19:51:37.305341 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:37.305130    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq" event={"ID":"00592eb2-f163-45cc-9b8d-8d63156eb590","Type":"ContainerStarted","Data":"4e60f74d3f01254e6b33a6d791b150a74a28e7b4d648079de87172d4f713b03c"}
May 26 19:51:42.327138 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:42.327034    2561 generic.go:358] "Generic (PLEG): container finished" podID="00592eb2-f163-45cc-9b8d-8d63156eb590" containerID="fa118aa7db57c04a9531ff3e6c61687b6193da985310b0054e8528b3b912c726" exitCode=0
May 26 19:51:42.327138 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:42.327116    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq" event={"ID":"00592eb2-f163-45cc-9b8d-8d63156eb590","Type":"ContainerDied","Data":"fa118aa7db57c04a9531ff3e6c61687b6193da985310b0054e8528b3b912c726"}
May 26 19:51:43.331827 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:43.331797    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq" event={"ID":"00592eb2-f163-45cc-9b8d-8d63156eb590","Type":"ContainerStarted","Data":"4092e9b79f1d6073b4b007ff9d674d43702a47223620def778aca81cab9ca053"}
May 26 19:51:43.332280 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:43.332046    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:51:43.354436 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:43.354374    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq" podStartSLOduration=8.13522902 podStartE2EDuration="8.354357181s" podCreationTimestamp="2026-05-26 19:51:35 +0000 UTC" firstStartedPulling="2026-05-26 19:51:42.327869733 +0000 UTC m=+676.807017354" lastFinishedPulling="2026-05-26 19:51:42.546997891 +0000 UTC m=+677.026145515" observedRunningTime="2026-05-26 19:51:43.353488378 +0000 UTC m=+677.832636026" watchObservedRunningTime="2026-05-26 19:51:43.354357181 +0000 UTC m=+677.833504825"
May 26 19:51:54.349051 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:51:54.349018    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq"
May 26 19:52:24.998050 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:52:24.998006    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:52:34.490460 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:52:34.490420    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:52:44.001854 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:52:44.001815    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:52:55.005602 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:52:55.005561    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:53:03.395069 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:03.395030    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:53:14.104428 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:14.104386    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:53:20.662308 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:20.662244    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:53:20.662769 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:20.662524    2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" podUID="cb17979d-1ba2-4295-8495-d5eb093b2964" containerName="manager" containerID="cri-o://cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170" gracePeriod=30
May 26 19:53:20.909061 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:20.909038    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:53:20.969863 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:20.969831    2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-944rw\" (UniqueName: \"kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw\") pod \"cb17979d-1ba2-4295-8495-d5eb093b2964\" (UID: \"cb17979d-1ba2-4295-8495-d5eb093b2964\") "
May 26 19:53:20.972132 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:20.972106    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw" (OuterVolumeSpecName: "kube-api-access-944rw") pod "cb17979d-1ba2-4295-8495-d5eb093b2964" (UID: "cb17979d-1ba2-4295-8495-d5eb093b2964"). InnerVolumeSpecName "kube-api-access-944rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:53:21.071114 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.071071    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-944rw\" (UniqueName: \"kubernetes.io/projected/cb17979d-1ba2-4295-8495-d5eb093b2964-kube-api-access-944rw\") on node \"ip-10-0-137-200.ec2.internal\" DevicePath \"\""
May 26 19:53:21.683447 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.683410    2561 generic.go:358] "Generic (PLEG): container finished" podID="cb17979d-1ba2-4295-8495-d5eb093b2964" containerID="cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170" exitCode=0
May 26 19:53:21.683945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.683489    2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns"
May 26 19:53:21.683945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.683519    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" event={"ID":"cb17979d-1ba2-4295-8495-d5eb093b2964","Type":"ContainerDied","Data":"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"}
May 26 19:53:21.683945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.683583    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dfbf9bc5-ll8ns" event={"ID":"cb17979d-1ba2-4295-8495-d5eb093b2964","Type":"ContainerDied","Data":"dd32afb23cdc1d2b07a9fed0563af0d6894b71b6dc50b1e4cb8b58c4a56b533d"}
May 26 19:53:21.683945 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.683610    2561 scope.go:117] "RemoveContainer" containerID="cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"
May 26 19:53:21.692612 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.692580    2561 scope.go:117] "RemoveContainer" containerID="cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"
May 26 19:53:21.692930 ip-10-0-137-200 kubenswrapper[2561]: E0526 19:53:21.692887    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170\": container with ID starting with cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170 not found: ID does not exist" containerID="cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"
May 26 19:53:21.693042 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.693021    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170"} err="failed to get container status \"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170\": rpc error: code = NotFound desc = could not find container \"cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170\": container with ID starting with cd668532286c59982a8ee33b7e7d8d6e425df2fb30b4ed3ad8abeab5e44fb170 not found: ID does not exist"
May 26 19:53:21.705626 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.705591    2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:53:21.709302 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:21.709275    2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59dfbf9bc5-ll8ns"]
May 26 19:53:22.132443 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:22.132361    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb17979d-1ba2-4295-8495-d5eb093b2964" path="/var/lib/kubelet/pods/cb17979d-1ba2-4295-8495-d5eb093b2964/volumes"
May 26 19:53:47.202641 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:47.202555    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:53:52.894453 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:53:52.894413    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:54:28.383130 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:54:28.383094    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:54:43.591501 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:54:43.591456    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:55:22.192157 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:55:22.192112    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:55:37.791560 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:55:37.791510    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:55:52.795182 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:55:52.795148    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:56:09.396122 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:56:09.396088    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:57:03.193157 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:57:03.193071    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:57:12.895385 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:57:12.895299    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:57:29.990890 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:57:29.990849    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:57:38.392766 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:57:38.392724    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:57:54.895399 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:57:54.895361    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:58:03.191467 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:58:03.191430    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:58:35.987046 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:58:35.987007    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:58:44.988263 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:58:44.988226    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:58:52.988510 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:58:52.988471    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:59:01.392192 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:59:01.392156    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:59:09.891931 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:59:09.891886    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:59:27.192548 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:59:27.192504    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 19:59:39.488552 ip-10-0-137-200 kubenswrapper[2561]: I0526 19:59:39.488457    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:00:25.992474 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:00:25.992434    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:00:30.694395 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:00:30.694355    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:00:40.193571 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:00:40.193530    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:00:47.991645 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:00:47.991608    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:00:57.794816 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:00:57.794770    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:05.892898 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:05.892812    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:15.098870 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:15.095064    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:22.896095 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:22.896055    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:32.294246 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:32.294202    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:40.388324 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:40.388283    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:50.493634 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:50.493598    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:01:58.300433 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:01:58.300394    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:07.490949 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:07.490900    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:15.695284 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:15.695237    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:24.603096 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:24.603046    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:33.299291 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:33.299252    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:42.694657 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:42.694618    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:02:50.720986 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:02:50.720944    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:05:08.791046 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:05:08.791002    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:05:13.797130 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:05:13.797093    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:05:38.686802 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:05:38.686704    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:05:43.587621 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:05:43.587580    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:05:52.895192 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:05:52.895149    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:03.795840 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:03.795804    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:12.491366 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:12.491323    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:23.498289 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:23.498243    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:31.695807 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:31.695766    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:42.295196 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:42.295159    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:06:50.592378 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:06:50.592343    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:07:01.489740 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:07:01.489703    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:07:11.094501 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:07:11.094414    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:07:45.188233 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:07:45.188198    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:08:28.607083 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:08:28.607043    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:08:36.698189 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:08:36.698105    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:08:45.799222 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:08:45.799172    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:08:54.489500 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:08:54.489462    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:03.498941 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:03.498893    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:15.097606 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:15.097569    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:25.199234 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:25.199191    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:33.314797 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:33.314762    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:40.696720 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:40.696680    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:49.096726 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:49.096691    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:09:57.590594 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:09:57.590553    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:10:08.297342 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:10:08.297262    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:10:26.992901 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:10:26.992862    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:10:34.288075 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:10:34.288036    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:10:43.697708 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:10:43.697666    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:10:51.588080 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:10:51.588039    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:08.399591 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:08.399549    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:16.798294 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:16.798256    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:25.998168 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:25.998130    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:34.199642 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:34.199550    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:43.799160 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:43.799116    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:11:51.807644 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:11:51.807605    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:01.591931 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:01.591878    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:11.788664 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:11.788623    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:20.497430 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:20.497389    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:31.694844 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:31.694799    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:40.790693 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:40.790645    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:48.895542 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:48.895503    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:12:57.194377 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:12:57.194335    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:13:04.488842 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:13:04.488755    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:13:21.293529 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:13:21.293487    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:13:31.190232 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:13:31.190190    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:13:38.797005 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:13:38.796966    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:13:48.091111 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:13:48.091072    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:14:11.297442 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:11.297402    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:14:23.989931 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:23.989890    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jvw6h"]
May 26 20:14:32.103406 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:32.103370    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-hs4nk_871982d9-3484-4e94-94f0-e2b738fd5400/manager/0.log"
May 26 20:14:32.567050 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:32.567015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7hg4w_ac759abb-6062-4ccb-8e5c-419e74e2a61d/manager/1.log"
May 26 20:14:32.909956 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:32.909865    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8645bcd494-wwft8_32faa720-759e-43e6-9f02-6e0e6cdd62fa/manager/0.log"
May 26 20:14:33.017411 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:33.017378    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t99ns_2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b/postgres/0.log"
May 26 20:14:34.533960 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:34.533864    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-svsg6_9c5a66c3-45fd-4791-bc0f-f117fa646ef4/manager/0.log"
May 26 20:14:35.008164 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:35.008136    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jvw6h_54e56494-0ae5-4548-8da9-46c3bf5260db/limitador/0.log"
May 26 20:14:35.585818 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:35.585789    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-fc4lj_69f8a847-1d56-46a5-92a2-d1fc2430275f/discovery/0.log"
May 26 20:14:35.811542 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:35.811510    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-646c6699bc-xkrwz_67d73c45-8b17-4d7c-bcff-10e4605c540a/kube-auth-proxy/0.log"
May 26 20:14:35.927224 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:35.927147    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-p2pgt_7a5f0963-bfb3-419b-be88-3b267e4e313b/istio-proxy/0.log"
May 26 20:14:36.039522 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:36.039493    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-gdjzk_f0cb6404-ce95-4fa7-8973-20e5a9d66bce/payload-processing/0.log"
May 26 20:14:36.516110 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:36.516068    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq_00592eb2-f163-45cc-9b8d-8d63156eb590/storage-initializer/0.log"
May 26 20:14:36.522178 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:36.522158    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-jw6cq_00592eb2-f163-45cc-9b8d-8d63156eb590/main/0.log"
May 26 20:14:36.632540 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:36.632508    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4_ed2549fb-eed7-4df9-9aef-9d2c72697796/storage-initializer/0.log"
May 26 20:14:36.639127 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:36.639099    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-262x4_ed2549fb-eed7-4df9-9aef-9d2c72697796/main/0.log"
May 26 20:14:37.105216 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:37.105177    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-g92nz_29f36d0a-699e-4c7d-8953-b6f5f34ccdb3/storage-initializer/0.log"
May 26 20:14:37.111903 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:37.111876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-g92nz_29f36d0a-699e-4c7d-8953-b6f5f34ccdb3/main/0.log"
May 26 20:14:44.706206 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:44.706166    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kfqbk_4d9c95f7-61b1-4c6b-bb08-1a18fb05fe7c/global-pull-secret-syncer/0.log"
May 26 20:14:44.860146 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:44.860110    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v6njc_d2ff80e3-824f-4dba-aa05-e54633132373/konnectivity-agent/0.log"
May 26 20:14:44.902121 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:44.902087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-200.ec2.internal_c66f86e1ffcc081e15ecdd4acdb9df2b/haproxy/0.log"
May 26 20:14:49.753745 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:49.753714    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-svsg6_9c5a66c3-45fd-4791-bc0f-f117fa646ef4/manager/0.log"
May 26 20:14:49.934626 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:49.934592    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jvw6h_54e56494-0ae5-4548-8da9-46c3bf5260db/limitador/0.log"
May 26 20:14:51.759337 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:51.759306    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/node-exporter/0.log"
May 26 20:14:51.789585 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:51.789556    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/kube-rbac-proxy/0.log"
May 26 20:14:51.808933 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:51.808880    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7kcc4_4315d980-dcca-4376-9257-3d1e59a441ab/init-textfile/0.log"
May 26 20:14:53.332160 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.332124    2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"]
May 26 20:14:53.332522 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.332457    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb17979d-1ba2-4295-8495-d5eb093b2964" containerName="manager"
May 26 20:14:53.332522 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.332468    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb17979d-1ba2-4295-8495-d5eb093b2964" containerName="manager"
May 26 20:14:53.332590 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.332534    2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="cb17979d-1ba2-4295-8495-d5eb093b2964" containerName="manager"
May 26 20:14:53.335336 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.335314    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.337982 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.337950    2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c2zrb\"/\"default-dockercfg-nc7w7\""
May 26 20:14:53.338123 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.337986    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2zrb\"/\"kube-root-ca.crt\""
May 26 20:14:53.339069 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.339052    2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2zrb\"/\"openshift-service-ca.crt\""
May 26 20:14:53.343172 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.343149    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"]
May 26 20:14:53.355833 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.355724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-sys\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.355833 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.355811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwrn6\" (UniqueName: \"kubernetes.io/projected/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-kube-api-access-fwrn6\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.356097 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.355844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-lib-modules\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.356097 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.355886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-podres\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.356097 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.355950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-proc\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457031 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.456989    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-sys\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457053    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwrn6\" (UniqueName: \"kubernetes.io/projected/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-kube-api-access-fwrn6\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457076    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-lib-modules\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457107    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-podres\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-sys\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457136    2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-proc\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457217 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457211    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-proc\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457452 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457212    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-podres\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.457452 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.457249    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-lib-modules\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.465210 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.465188    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwrn6\" (UniqueName: \"kubernetes.io/projected/9d9df6e8-dbac-4a5e-bfba-fb808cf03c81-kube-api-access-fwrn6\") pod \"perf-node-gather-daemonset-qbk8b\" (UID: \"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.646754 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.646664    2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:53.777111 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.777085    2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"]
May 26 20:14:53.779794 ip-10-0-137-200 kubenswrapper[2561]: W0526 20:14:53.779750    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9d9df6e8_dbac_4a5e_bfba_fb808cf03c81.slice/crio-4d01d184ea7ca1d07cf11756e8a6ba56e061ea14aaec48f8021217260b8f5931 WatchSource:0}: Error finding container 4d01d184ea7ca1d07cf11756e8a6ba56e061ea14aaec48f8021217260b8f5931: Status 404 returned error can't find the container with id 4d01d184ea7ca1d07cf11756e8a6ba56e061ea14aaec48f8021217260b8f5931
May 26 20:14:53.781548 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:53.781527    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:14:54.141844 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:54.141805    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b" event={"ID":"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81","Type":"ContainerStarted","Data":"727753a73315e51f75e4b6691c15c33808ed38698779f290788613a091d8c15d"}
May 26 20:14:54.141844 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:54.141840    2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b" event={"ID":"9d9df6e8-dbac-4a5e-bfba-fb808cf03c81","Type":"ContainerStarted","Data":"4d01d184ea7ca1d07cf11756e8a6ba56e061ea14aaec48f8021217260b8f5931"}
May 26 20:14:54.142088 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:54.141922    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:14:54.157105 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:54.157054    2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b" podStartSLOduration=1.157035295 podStartE2EDuration="1.157035295s" podCreationTimestamp="2026-05-26 20:14:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:14:54.156478005 +0000 UTC m=+2068.635625647" watchObservedRunningTime="2026-05-26 20:14:54.157035295 +0000 UTC m=+2068.636182939"
May 26 20:14:55.724360 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:55.724327    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lcmsw_1a9c632b-2ab2-4084-9d38-b98c5ac60f72/dns/0.log"
May 26 20:14:55.743046 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:55.743016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lcmsw_1a9c632b-2ab2-4084-9d38-b98c5ac60f72/kube-rbac-proxy/0.log"
May 26 20:14:55.826821 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:55.826789    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f7brn_b0060e8e-2124-4e14-beef-9cdd53f410a1/dns-node-resolver/0.log"
May 26 20:14:56.291322 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:56.291296    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7h4nj_729e6bef-49f5-453b-83cd-601759cf885d/node-ca/0.log"
May 26 20:14:57.195556 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:57.195524    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-fc4lj_69f8a847-1d56-46a5-92a2-d1fc2430275f/discovery/0.log"
May 26 20:14:57.237028 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:57.237003    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-646c6699bc-xkrwz_67d73c45-8b17-4d7c-bcff-10e4605c540a/kube-auth-proxy/0.log"
May 26 20:14:57.290690 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:57.290663    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-p2pgt_7a5f0963-bfb3-419b-be88-3b267e4e313b/istio-proxy/0.log"
May 26 20:14:57.343837 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:57.343796    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-gdjzk_f0cb6404-ce95-4fa7-8973-20e5a9d66bce/payload-processing/0.log"
May 26 20:14:57.841592 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:57.841565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2m6fd_8b228343-2f31-4961-a671-f4ed4737f117/serve-healthcheck-canary/0.log"
May 26 20:14:58.451042 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:58.451016    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxtjs_099047a0-0464-41b9-9372-fece94307f2d/kube-rbac-proxy/0.log"
May 26 20:14:58.469114 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:58.469086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxtjs_099047a0-0464-41b9-9372-fece94307f2d/exporter/0.log"
May 26 20:14:58.489363 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:14:58.489338    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxtjs_099047a0-0464-41b9-9372-fece94307f2d/extractor/0.log"
May 26 20:15:00.156715 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.156685    2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-qbk8b"
May 26 20:15:00.314660 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.314630    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-hs4nk_871982d9-3484-4e94-94f0-e2b738fd5400/manager/0.log"
May 26 20:15:00.473326 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.473292    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7hg4w_ac759abb-6062-4ccb-8e5c-419e74e2a61d/manager/0.log"
May 26 20:15:00.482840 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.482813    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-7hg4w_ac759abb-6062-4ccb-8e5c-419e74e2a61d/manager/1.log"
May 26 20:15:00.597433 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.597401    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8645bcd494-wwft8_32faa720-759e-43e6-9f02-6e0e6cdd62fa/manager/0.log"
May 26 20:15:00.621658 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:00.621632    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-t99ns_2f23e7e6-ef7c-4e4e-929f-254f7c23bb1b/postgres/0.log"
May 26 20:15:01.727269 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:01.727243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-k8t2x_3db9f6a4-8c08-4379-bfb9-6d8664c201fb/openshift-lws-operator/0.log"
May 26 20:15:07.471106 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.471077    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/kube-multus-additional-cni-plugins/0.log"
May 26 20:15:07.490011 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.489986    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/egress-router-binary-copy/0.log"
May 26 20:15:07.508445 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.508422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/cni-plugins/0.log"
May 26 20:15:07.530753 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.530725    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/bond-cni-plugin/0.log"
May 26 20:15:07.550005 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.549967    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/routeoverride-cni/0.log"
May 26 20:15:07.572432 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.572406    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/whereabouts-cni-bincopy/0.log"
May 26 20:15:07.590578 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.590551    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c8t7g_bca0cc84-f86a-4950-ba65-0416612fbcd5/whereabouts-cni/0.log"
May 26 20:15:07.896650 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.896572    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fc6dv_04790958-b52a-4e74-b3e1-9ee83cf04710/kube-multus/0.log"
May 26 20:15:07.973589 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.973561    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-854dh_97106aed-260f-4660-9104-3cc42b40f829/network-metrics-daemon/0.log"
May 26 20:15:07.991451 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:07.991421    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-854dh_97106aed-260f-4660-9104-3cc42b40f829/kube-rbac-proxy/0.log"
May 26 20:15:08.861252 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.861215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/ovn-controller/0.log"
May 26 20:15:08.887779 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.887747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/ovn-acl-logging/0.log"
May 26 20:15:08.904035 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.904001    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/kube-rbac-proxy-node/0.log"
May 26 20:15:08.923386 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.923358    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/kube-rbac-proxy-ovn-metrics/0.log"
May 26 20:15:08.941058 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.941029    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/northd/0.log"
May 26 20:15:08.959642 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.959610    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/nbdb/0.log"
May 26 20:15:08.978507 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:08.978482    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/sbdb/0.log"
May 26 20:15:09.069193 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:09.069164    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5jf8m_a2929769-702f-4c06-aab9-acf091e3270a/ovnkube-controller/0.log"
May 26 20:15:10.747705 ip-10-0-137-200 kubenswrapper[2561]: I0526 20:15:10.747675    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-kvrzg_ec1f9b1b-7131-4aca-b877-13e671c7a013/network-check-target-container/0.log"