May 20 21:45:44.296494 ip-10-0-131-201 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 20 21:45:44.296504 ip-10-0-131-201 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 20 21:45:44.296510 ip-10-0-131-201 systemd[1]: kubelet.service: Failed with result 'resources'.
May 20 21:45:44.296726 ip-10-0-131-201 systemd[1]: Failed to start Kubernetes Kubelet.
May 20 21:45:54.470482 ip-10-0-131-201 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 20 21:45:54.470500 ip-10-0-131-201 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1ac27a1452084837a6405cf22182019c --
May 20 21:48:09.434230 ip-10-0-131-201 systemd[1]: Starting Kubernetes Kubelet...
May 20 21:48:09.865546 ip-10-0-131-201 kubenswrapper[2523]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:48:09.865546 ip-10-0-131-201 kubenswrapper[2523]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 20 21:48:09.865546 ip-10-0-131-201 kubenswrapper[2523]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:48:09.865546 ip-10-0-131-201 kubenswrapper[2523]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 20 21:48:09.865546 ip-10-0-131-201 kubenswrapper[2523]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 20 21:48:09.867912 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.867839    2523 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 20 21:48:09.870655 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870637    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:48:09.870655 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870653    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870660    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870665    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870670    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870675    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870679    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870682    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870686    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870690    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870701    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870705    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870709    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870713    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870717    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870721    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870725    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870729    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870733    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870738    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:48:09.870789 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870744    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870748    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870753    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870757    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870762    2523 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870766    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870773    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870777    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870781    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870785    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870789    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870793    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870797    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870800    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870805    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870809    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870812    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870816    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870820    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870825    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:48:09.871566 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870829    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870833    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870837    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870841    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870845    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870849    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870852    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870856    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870860    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870864    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870867    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870871    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870875    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870878    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870883    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870887    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870891    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870895    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870899    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870903    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:48:09.872302 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870907    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870911    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870914    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870918    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870922    2523 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870927    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870949    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870954    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870958    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870962    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870965    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870969    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870973    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870977    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870981    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870985    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870990    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870994    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.870998    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871002    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:48:09.872781 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871006    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871011    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871014    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871018    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871024    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871028    2523 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871611    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871619    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871623    2523 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871627    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871631    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871635    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871640    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871647    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871653    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871657    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871661    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871666    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871670    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:48:09.873284 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871674    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871679    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871683    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871687    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871691    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871695    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871699    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871703    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871707    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871712    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871716    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871719    2523 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871723    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871727    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871731    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871737    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871742    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871745    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871749    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871754    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:48:09.874015 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871758    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871762    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871766    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871770    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871783    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871787    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871791    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871795    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871798    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871803    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871808    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871812    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871816    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871820    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871824    2523 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871827    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871831    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871836    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871840    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871843    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:48:09.874818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871847    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871851    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871857    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871861    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871865    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871870    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871873    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871877    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871883    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871887    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871891    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871895    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871899    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871903    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871906    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871910    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871914    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871918    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871922    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871926    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:48:09.875565 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871948    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871953    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871957    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871961    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871964    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871968    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871972    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871976    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871980    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871984    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871988    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871992    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.871996    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873378    2523 flags.go:64] FLAG: --address="0.0.0.0"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873402    2523 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873415    2523 flags.go:64] FLAG: --anonymous-auth="true"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873423    2523 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873429    2523 flags.go:64] FLAG: --authentication-token-webhook="false"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873434    2523 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873440    2523 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873446    2523 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 20 21:48:09.876283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873452    2523 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873457    2523 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873461    2523 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873467    2523 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873471    2523 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873476    2523 flags.go:64] FLAG: --cgroup-root=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873481    2523 flags.go:64] FLAG: --cgroups-per-qos="true"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873486    2523 flags.go:64] FLAG: --client-ca-file=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873491    2523 flags.go:64] FLAG: --cloud-config=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873495    2523 flags.go:64] FLAG: --cloud-provider="external"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873500    2523 flags.go:64] FLAG: --cluster-dns="[]"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873508    2523 flags.go:64] FLAG: --cluster-domain=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873512    2523 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873517    2523 flags.go:64] FLAG: --config-dir=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873521    2523 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873527    2523 flags.go:64] FLAG: --container-log-max-files="5"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873532    2523 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873538    2523 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873543    2523 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873548    2523 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873552    2523 flags.go:64] FLAG: --contention-profiling="false"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873557    2523 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873562    2523 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873567    2523 flags.go:64] FLAG: --cpu-manager-policy="none"
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873571    2523 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 20 21:48:09.876788 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873577    2523 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873582    2523 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873588    2523 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873592    2523 flags.go:64] FLAG: --enable-load-reader="false"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873596    2523 flags.go:64] FLAG: --enable-server="true"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873601    2523 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873607    2523 flags.go:64] FLAG: --event-burst="100"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873612    2523 flags.go:64] FLAG: --event-qps="50"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873619    2523 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873624    2523 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873628    2523 flags.go:64] FLAG: --eviction-hard=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873634    2523 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873638    2523 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873643    2523 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873648    2523 flags.go:64] FLAG: --eviction-soft=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873652    2523 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873656    2523 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873661    2523 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873666    2523 flags.go:64] FLAG: --experimental-mounter-path=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873670    2523 flags.go:64] FLAG: --fail-cgroupv1="false"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873674    2523 flags.go:64] FLAG: --fail-swap-on="true"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873679    2523 flags.go:64] FLAG: --feature-gates=""
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873686    2523 flags.go:64] FLAG: --file-check-frequency="20s"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873691    2523 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873696    2523 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 20 21:48:09.877510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873701    2523 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873706    2523 flags.go:64] FLAG: --healthz-port="10248"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873711    2523 flags.go:64] FLAG: --help="false"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873716    2523 flags.go:64] FLAG: --hostname-override="ip-10-0-131-201.ec2.internal"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873721    2523 flags.go:64] FLAG: --housekeeping-interval="10s"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873726    2523 flags.go:64] FLAG: --http-check-frequency="20s"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873730    2523 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873736    2523 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873741    2523 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873746    2523 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873751    2523 flags.go:64] FLAG: --image-service-endpoint=""
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873756    2523 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873760    2523 flags.go:64] FLAG: --kube-api-burst="100"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873764    2523 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873769    2523 flags.go:64] FLAG: --kube-api-qps="50"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873775    2523 flags.go:64] FLAG: --kube-reserved=""
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873780    2523 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873784    2523 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873789    2523 flags.go:64] FLAG: --kubelet-cgroups=""
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873794    2523 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873799    2523 flags.go:64] FLAG: --lock-file=""
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873803    2523 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873808    2523 flags.go:64] FLAG: --log-flush-frequency="5s"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873813    2523 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 20 21:48:09.878125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873821    2523 flags.go:64] FLAG: --log-json-split-stream="false"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873826    2523 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873830    2523 flags.go:64] FLAG: --log-text-split-stream="false"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873835    2523 flags.go:64] FLAG: --logging-format="text"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873839    2523 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873845    2523 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873850    2523 flags.go:64] FLAG: --manifest-url=""
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873854    2523 flags.go:64] FLAG: --manifest-url-header=""
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873861    2523 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873866    2523 flags.go:64] FLAG: --max-open-files="1000000"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873872    2523 flags.go:64] FLAG: --max-pods="110"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873876    2523 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873881    2523 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873886    2523 flags.go:64] FLAG: --memory-manager-policy="None"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873890    2523 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873895    2523 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873900    2523 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873904    2523 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873915    2523 flags.go:64] FLAG: --node-status-max-images="50"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873920    2523 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873925    2523 flags.go:64] FLAG: --oom-score-adj="-999"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873948    2523 flags.go:64] FLAG: --pod-cidr=""
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873953    2523 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 20 21:48:09.878685 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873963    2523 flags.go:64] FLAG: --pod-manifest-path=""
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873967    2523 flags.go:64] FLAG: --pod-max-pids="-1"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873971    2523 flags.go:64] FLAG: --pods-per-core="0"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873975    2523 flags.go:64] FLAG: --port="10250"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873980    2523 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873984    2523 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04d1f1b9d833ade3a"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873989    2523 flags.go:64] FLAG: --qos-reserved=""
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873994    2523 flags.go:64] FLAG: --read-only-port="10255"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.873998    2523 flags.go:64] FLAG: --register-node="true"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874003    2523 flags.go:64] FLAG: --register-schedulable="true"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874007    2523 flags.go:64] FLAG: --register-with-taints=""
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874012    2523 flags.go:64] FLAG: --registry-burst="10"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874017    2523 flags.go:64] FLAG: --registry-qps="5"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874020    2523 flags.go:64] FLAG: --reserved-cpus=""
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874025    2523 flags.go:64] FLAG: --reserved-memory=""
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874030    2523 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874035    2523 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874039    2523 flags.go:64] FLAG: --rotate-certificates="false"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874044    2523 flags.go:64] FLAG: --rotate-server-certificates="false"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874048    2523 flags.go:64] FLAG: --runonce="false"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874053    2523 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874057    2523 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874062    2523 flags.go:64] FLAG: --seccomp-default="false"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874067    2523 flags.go:64] FLAG: --serialize-image-pulls="true"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874072    2523 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874076    2523 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 20 21:48:09.879254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874081    2523 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874085    2523 flags.go:64] FLAG: --storage-driver-password="root"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874090    2523 flags.go:64] FLAG: --storage-driver-secure="false"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874095    2523 flags.go:64] FLAG: --storage-driver-table="stats"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874099    2523 flags.go:64] FLAG: --storage-driver-user="root"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874104    2523 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874109    2523 flags.go:64] FLAG: --sync-frequency="1m0s"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874113    2523 flags.go:64] FLAG: --system-cgroups=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874117    2523 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874126    2523 flags.go:64] FLAG: --system-reserved-cgroup=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874130    2523 flags.go:64] FLAG: --tls-cert-file=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874135    2523 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874141    2523 flags.go:64] FLAG: --tls-min-version=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874145    2523 flags.go:64] FLAG: --tls-private-key-file=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874150    2523 flags.go:64] FLAG: --topology-manager-policy="none"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874154    2523 flags.go:64] FLAG: --topology-manager-policy-options=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874158    2523 flags.go:64] FLAG: --topology-manager-scope="container"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874163    2523 flags.go:64] FLAG: --v="2"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874170    2523 flags.go:64] FLAG: --version="false"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874176    2523 flags.go:64] FLAG: --vmodule=""
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874182    2523 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.874186    2523 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874328    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874335    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:48:09.879857 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874340    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874345    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874349    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874354    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874358    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874362    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874366    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874370    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874374    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874380    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874385    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874389    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874394    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874398    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874402    2523 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874406    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874409    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874413    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874417    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874421    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:48:09.880500 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874424    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874428    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874432    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874435    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874439    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874443    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874447    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874452    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874455    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874459    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874463    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874468    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874472    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874476    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874480    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874484    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874488    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874492    2523 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874496    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874500    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:48:09.881260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874503    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874507    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874511    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874515    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874518    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874523    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874527    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874531    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874535    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874539    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874543    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874548    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874552    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874556    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874559    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874564    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874568    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874572    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874576    2523 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:48:09.881842 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874580    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874584    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874590    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874596    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874602    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874607    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874611    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874615    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874620    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874624    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874628    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874632    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874636    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874639    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874643    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874647    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874651    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874655    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874659    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:48:09.882308 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874664    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874668    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874671    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874675    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874679    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.874683    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.875231    2523 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.882738    2523 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 20 21:48:09.882768 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.882757    2523 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882801    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882806    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882809    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882812    2523 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882816    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882818    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882821    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882824    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882827    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882830    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882832    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882834    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882837    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882839    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882842    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882844    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882847    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882849    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882852    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:48:09.882996 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882855    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882857    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882860    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882863    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882865    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882867    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882871    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882875    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882878    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882881    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882884    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882886    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882889    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882893    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882896    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882898    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882901    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882904    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882907    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882910    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:48:09.883473 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882913    2523 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882915    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882918    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882920    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882923    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882925    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882927    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882948    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882951    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882954    2523 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882956    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882958    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882961    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882964    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882966    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882968    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882971    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882973    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882976    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:48:09.884034 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882978    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882981    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882983    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882986    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882988    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882991    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882993    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882996    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.882999    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883001    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883004    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883006    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883009    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883011    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883014    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883016    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883019    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883021    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883024    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883026    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:48:09.884474 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883029    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883031    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883033    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883036    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883040    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883043    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883046    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883049    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.883054    2523 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883174    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883179    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883183    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883186    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883190    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 20 21:48:09.884959 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883192    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883195    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883198    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883200    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883203    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883207    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883209    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883212    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883214    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883217    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883219    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883222    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883224    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883227    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883229    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883232    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883234    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883238    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883240    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883243    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 20 21:48:09.885301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883245    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883248    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883250    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883252    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883255    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883257    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883259    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883262    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883264    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883267    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883269    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883271    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883274    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883276    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883278    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883281    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883284    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883286    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883288    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883291    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 20 21:48:09.885776 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883293    2523 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883296    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883298    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883300    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883302    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883305    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883307    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883309    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883312    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883314    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883317    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883319    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883322    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883324    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883327    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883329    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883332    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883334    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883337    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883339    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 20 21:48:09.886263 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883341    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883344    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883346    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883348    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883351    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883353    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883356    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883358    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883361    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883363    2523 feature_gate.go:328] unrecognized feature gate: Example2
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883365    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883367    2523 feature_gate.go:328] unrecognized feature gate: Example
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883370    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883372    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883374    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883377    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883379    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883381    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883384    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883386    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 20 21:48:09.886724 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:09.883390    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 20 21:48:09.887223 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.883394    2523 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 20 21:48:09.887223 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.883500    2523 server.go:962] "Client rotation is on, will bootstrap in background"
May 20 21:48:09.887223 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.887209    2523 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 20 21:48:09.888024 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.888012    2523 server.go:1019] "Starting client certificate rotation"
May 20 21:48:09.888125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.888109    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 21:48:09.888161 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.888149    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 20 21:48:09.910285 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.910268    2523 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 21:48:09.911967 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.911948    2523 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 20 21:48:09.925067 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.924976    2523 log.go:25] "Validated CRI v1 runtime API"
May 20 21:48:09.932211 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.932197    2523 log.go:25] "Validated CRI v1 image API"
May 20 21:48:09.933500 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.933481    2523 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 20 21:48:09.936452 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.936434    2523 fs.go:135] Filesystem UUIDs: map[6d1d409d-0a4a-4118-b2b4-e1f98cc1d458:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 abe04cfa-c0d3-42f1-8711-ad4ed131dbf2:/dev/nvme0n1p3]
May 20 21:48:09.936511 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.936452    2523 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 20 21:48:09.940572 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.940475    2523 manager.go:217] Machine: {Timestamp:2026-05-20 21:48:09.940007623 +0000 UTC m=+0.384274316 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204591 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b522026182606837b4a6c464962d0 SystemUUID:ec2b5220-2618-2606-837b-4a6c464962d0 BootID:1ac27a14-5208-4837-a640-5cf22182019c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:90:53:a0:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:90:53:a0:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:aa:02:1b:5b:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 20 21:48:09.940572 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.940571    2523 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 20 21:48:09.940668 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.940633    2523 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 20 21:48:09.942174 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.942151    2523 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 20 21:48:09.942323 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.942177    2523 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 20 21:48:09.942368 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.942335    2523 topology_manager.go:138] "Creating topology manager with none policy"
May 20 21:48:09.942368 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.942344    2523 container_manager_linux.go:306] "Creating device plugin manager"
May 20 21:48:09.942368 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.942350    2523 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 21:48:09.943334 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.943323    2523 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 20 21:48:09.945311 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.945300    2523 state_mem.go:36] "Initialized new in-memory state store"
May 20 21:48:09.945421 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.945412    2523 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 20 21:48:09.947992 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.947982    2523 kubelet.go:491] "Attempting to sync node with API server"
May 20 21:48:09.948025 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.947997    2523 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 20 21:48:09.948025 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.948009    2523 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 20 21:48:09.948025 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.948018    2523 kubelet.go:397] "Adding apiserver pod source"
May 20 21:48:09.948025 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.948026    2523 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 20 21:48:09.948988 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.948978    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 21:48:09.949024 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.948996    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 20 21:48:09.951755 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.951734    2523 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 20 21:48:09.952099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.952081    2523 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 21:48:09.954572 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.954559    2523 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 20 21:48:09.955352 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955341    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955358    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955364    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955373    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955382    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955387    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 20 21:48:09.955392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955393    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 20 21:48:09.955542 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955398    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 20 21:48:09.955542 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955405    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 20 21:48:09.955542 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955411    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 20 21:48:09.955542 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955424    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 20 21:48:09.955723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.955712    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 20 21:48:09.956510 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.956499    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 20 21:48:09.956545 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.956512    2523 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 20 21:48:09.959345 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.959332    2523 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 20 21:48:09.959394 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.959386    2523 server.go:1295] "Started kubelet"
May 20 21:48:09.960027 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.959978    2523 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 20 21:48:09.960085 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.960046    2523 server_v1.go:47] "podresources" method="list" useActivePods=true
May 20 21:48:09.960194 ip-10-0-131-201 systemd[1]: Started Kubernetes Kubelet.
May 20 21:48:09.960585 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.960217    2523 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 20 21:48:09.961393 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.961381    2523 server.go:317] "Adding debug handlers to kubelet server"
May 20 21:48:09.961491 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.961471    2523 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 20 21:48:09.963531 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.963502    2523 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 20 21:48:09.963642 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.963537    2523 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 20 21:48:09.963642 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.963631    2523 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 20 21:48:09.966419 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.966398    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 20 21:48:09.966911 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.966896    2523 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 20 21:48:09.967026 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967004    2523 volume_manager.go:295] "The desired_state_of_world populator starts"
May 20 21:48:09.967026 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967023    2523 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 20 21:48:09.967143 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967119    2523 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 20 21:48:09.967208 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967160    2523 reconstruct.go:97] "Volume reconstruction finished"
May 20 21:48:09.967208 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967166    2523 reconciler.go:26] "Reconciler: start to sync state"
May 20 21:48:09.967208 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.967191    2523 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 20 21:48:09.967522 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967510    2523 factory.go:55] Registering systemd factory
May 20 21:48:09.967568 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967525    2523 factory.go:223] Registration of the systemd container factory successfully
May 20 21:48:09.967650 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.967633    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:09.967895 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967881    2523 factory.go:153] Registering CRI-O factory
May 20 21:48:09.967895 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967899    2523 factory.go:223] Registration of the crio container factory successfully
May 20 21:48:09.968063 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967975    2523 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 20 21:48:09.968063 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.967995    2523 factory.go:103] Registering Raw factory
May 20 21:48:09.968063 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.968009    2523 manager.go:1196] Started watching for new ooms in manager
May 20 21:48:09.968359 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.968345    2523 manager.go:319] Starting recovery of all containers
May 20 21:48:09.968856 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.968041    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-201.ec2.internal.18b1645fb2042f6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-201.ec2.internal,UID:ip-10-0-131-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-201.ec2.internal,},FirstTimestamp:2026-05-20 21:48:09.959346028 +0000 UTC m=+0.403612719,LastTimestamp:2026-05-20 21:48:09.959346028 +0000 UTC m=+0.403612719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-201.ec2.internal,}"
May 20 21:48:09.972920 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.972491    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w72m8"
May 20 21:48:09.974168 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.974126    2523 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 20 21:48:09.974309 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.974286    2523 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 20 21:48:09.975990 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.975975    2523 manager.go:324] Recovery completed
May 20 21:48:09.980401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.980384    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:09.982021 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982000    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w72m8"
May 20 21:48:09.982099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982027    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:09.982099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982051    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:09.982099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982070    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:09.982569 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982557    2523 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 20 21:48:09.982615 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982571    2523 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 20 21:48:09.982615 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.982588    2523 state_mem.go:36] "Initialized new in-memory state store"
May 20 21:48:09.984012 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:09.983954    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-201.ec2.internal.18b1645fb35e7cdf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-201.ec2.internal,UID:ip-10-0-131-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-201.ec2.internal,},FirstTimestamp:2026-05-20 21:48:09.982041311 +0000 UTC m=+0.426308004,LastTimestamp:2026-05-20 21:48:09.982041311 +0000 UTC m=+0.426308004,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-201.ec2.internal,}"
May 20 21:48:09.985024 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.985012    2523 policy_none.go:49] "None policy: Start"
May 20 21:48:09.985064 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.985035    2523 memory_manager.go:186] "Starting memorymanager" policy="None"
May 20 21:48:09.985064 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:09.985044    2523 state_mem.go:35] "Initializing new in-memory state store"
May 20 21:48:10.030534 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.030519    2523 manager.go:341] "Starting Device Plugin manager"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.030567    2523 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.030577    2523 server.go:85] "Starting device plugin registration server"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.030774    2523 eviction_manager.go:189] "Eviction manager: starting control loop"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.030785    2523 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.031008    2523 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.031100    2523 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.031110    2523 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.031580    2523 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 20 21:48:10.048969 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.031615    2523 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.070043 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.070017    2523 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 20 21:48:10.071260 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.071245    2523 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 20 21:48:10.071335 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.071266    2523 status_manager.go:230] "Starting to sync pod status with apiserver"
May 20 21:48:10.071335 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.071279    2523 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 20 21:48:10.071335 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.071286    2523 kubelet.go:2451] "Starting kubelet main sync loop"
May 20 21:48:10.071469 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.071348    2523 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 20 21:48:10.077660 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.077644    2523 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:48:10.130892 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.130850    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:10.132105 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.132090    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:10.132187 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.132123    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:10.132187 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.132137    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:10.132187 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.132163    2523 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-201.ec2.internal"
May 20 21:48:10.139950 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.139917    2523 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-201.ec2.internal"
May 20 21:48:10.140024 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.139959    2523 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-201.ec2.internal\": node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.152695 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.152673    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.172406 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.172382    2523 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"]
May 20 21:48:10.172465 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.172441    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:10.174331 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.174307    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:10.174331 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.174329    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:10.174441 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.174338    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:10.176489 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.176477    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:10.176641 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.176628    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.176720 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.176655    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:10.177132 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177118    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:10.177196 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177138    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:10.177196 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177152    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:10.177196 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177180    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:10.177329 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177206    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:10.177329 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.177221    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:10.179294 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.179278    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.179378 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.179300    2523 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 20 21:48:10.179965 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.179917    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientMemory"
May 20 21:48:10.179965 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.179959    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasNoDiskPressure"
May 20 21:48:10.180075 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.179970    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeHasSufficientPID"
May 20 21:48:10.207485 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.207466    2523 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-201.ec2.internal\" not found" node="ip-10-0-131-201.ec2.internal"
May 20 21:48:10.211789 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.211765    2523 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-201.ec2.internal\" not found" node="ip-10-0-131-201.ec2.internal"
May 20 21:48:10.253236 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.253221    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.268728 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.268710    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.268779 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.268733    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.268779 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.268748    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d60309927476571f99020f085b436480-config\") pod \"kube-apiserver-proxy-ip-10-0-131-201.ec2.internal\" (UID: \"d60309927476571f99020f085b436480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.354188 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.354169    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.369799 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369780    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.369846 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369804    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.369880 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369847    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d60309927476571f99020f085b436480-config\") pod \"kube-apiserver-proxy-ip-10-0-131-201.ec2.internal\" (UID: \"d60309927476571f99020f085b436480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.369880 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369874    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d60309927476571f99020f085b436480-config\") pod \"kube-apiserver-proxy-ip-10-0-131-201.ec2.internal\" (UID: \"d60309927476571f99020f085b436480\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.369964 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369876    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.369964 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.369911    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52f5d4a55e3a7c7f01b3406996678023-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal\" (UID: \"52f5d4a55e3a7c7f01b3406996678023\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.455153 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.455118    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.511548 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.511531    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.514142 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.514128    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:10.555633 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.555610    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.656097 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.656078    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.756585 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.756540    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.857049 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.857026    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.887490 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.887462    2523 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 20 21:48:10.887919 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.887600    2523 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 20 21:48:10.958037 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:10.958013    2523 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-201.ec2.internal\" not found"
May 20 21:48:10.966887 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.966865    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 20 21:48:10.983442 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.983407    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-19 21:43:09 +0000 UTC" deadline="2028-01-29 07:56:39.198033508 +0000 UTC"
May 20 21:48:10.983442 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.983435    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14842h8m28.214601167s"
May 20 21:48:10.984226 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:10.984208    2523 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 20 21:48:11.003280 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.003257    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2fvn"
May 20 21:48:11.011052 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.011036    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2fvn"
May 20 21:48:11.015572 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.015466    2523 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:48:11.021600 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:11.021577    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f5d4a55e3a7c7f01b3406996678023.slice/crio-dbb6b1c2af3d01cb7e2991e76b4e674737e52b1d625d27eb56390fd85fe2466a WatchSource:0}: Error finding container dbb6b1c2af3d01cb7e2991e76b4e674737e52b1d625d27eb56390fd85fe2466a: Status 404 returned error can't find the container with id dbb6b1c2af3d01cb7e2991e76b4e674737e52b1d625d27eb56390fd85fe2466a
May 20 21:48:11.021801 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:11.021784    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60309927476571f99020f085b436480.slice/crio-fe04719f5549a9da58e2f58620b94cada21a5387fdd7dee9380dace1ccbaa51f WatchSource:0}: Error finding container fe04719f5549a9da58e2f58620b94cada21a5387fdd7dee9380dace1ccbaa51f: Status 404 returned error can't find the container with id fe04719f5549a9da58e2f58620b94cada21a5387fdd7dee9380dace1ccbaa51f
May 20 21:48:11.026210 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.026189    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:48:11.067818 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.067802    2523 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal"
May 20 21:48:11.073573 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.073539    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal" event={"ID":"52f5d4a55e3a7c7f01b3406996678023","Type":"ContainerStarted","Data":"dbb6b1c2af3d01cb7e2991e76b4e674737e52b1d625d27eb56390fd85fe2466a"}
May 20 21:48:11.074426 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.074408    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal" event={"ID":"d60309927476571f99020f085b436480","Type":"ContainerStarted","Data":"fe04719f5549a9da58e2f58620b94cada21a5387fdd7dee9380dace1ccbaa51f"}
May 20 21:48:11.078509 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.078496    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 21:48:11.081467 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.081457    2523 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal"
May 20 21:48:11.087817 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.087795    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 20 21:48:11.317229 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.317175    2523 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:48:11.415971 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.415947    2523 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:48:11.949598 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.949523    2523 apiserver.go:52] "Watching apiserver"
May 20 21:48:11.957420 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.957400    2523 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 20 21:48:11.957820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.957792    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nrlgc","openshift-network-diagnostics/network-check-target-4xxqq","openshift-network-operator/iptables-alerter-nzzzf","openshift-ovn-kubernetes/ovnkube-node-dsx9x","kube-system/konnectivity-agent-rfdl8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs","openshift-cluster-node-tuning-operator/tuned-sl8mm","openshift-image-registry/node-ca-htjt7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal","openshift-multus/multus-t9rrx","kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal","openshift-dns/node-resolver-pvlst","openshift-multus/multus-additional-cni-plugins-47gqf"]
May 20 21:48:11.963421 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.963400    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.965507 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.965488    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:11.965617 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:11.965552    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:11.965617 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.965581    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:11.966499 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.966483    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htdhq\""
May 20 21:48:11.967308 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.967288    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 20 21:48:11.967443 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.967426    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 20 21:48:11.967723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.967710    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.970097 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.969908    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:11.972259 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.972241    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:11.973740 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.973416    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 20 21:48:11.973740 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.973522    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-grtw4\""
May 20 21:48:11.973837 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.973765    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 20 21:48:11.974370 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.974353    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 20 21:48:11.974562 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.974548    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 20 21:48:11.974794 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.974778    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 20 21:48:11.974882 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.974864    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 20 21:48:11.975134 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975115    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-959fk\""
May 20 21:48:11.975134 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975127    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 20 21:48:11.975279 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975192    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 20 21:48:11.975279 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975238    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 20 21:48:11.975378 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975332    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 20 21:48:11.975548 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.975526    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68728\""
May 20 21:48:11.976293 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976278    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 20 21:48:11.976380 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976298    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 20 21:48:11.976380 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976306    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-run\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976380 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976334    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-sys\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976380 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976364    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-lib-modules\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976390    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976427    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-netd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976451    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysconfig\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976467    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhls5\""
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976473    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq2hq\" (UniqueName: \"kubernetes.io/projected/6ab97df3-2bde-4621-9b49-ae50b0fce45b-kube-api-access-bq2hq\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976497    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-kubelet\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976311    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976519    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-modprobe-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976571 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976559    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqzd2\" (UniqueName: \"kubernetes.io/projected/56807105-68b2-46ee-a006-514b96328190-kube-api-access-pqzd2\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976664    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-etc-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976726    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-node-log\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976772    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976832    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-var-lib-kubelet\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976865    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-netns\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.976898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976889    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-bin\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.976913    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-config\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977045    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-env-overrides\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977072    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-systemd\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977106    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-tmp\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977145    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-systemd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977197    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977228    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977235    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvkpk\" (UniqueName: \"kubernetes.io/projected/69f19b4e-ad32-4085-8f69-7e5974cda1e0-kube-api-access-pvkpk\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977263    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977289    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-etc-tuned\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:11.977296    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977312    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-systemd-units\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977337    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-kubernetes\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977380    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-conf\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977412    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ab97df3-2bde-4621-9b49-ae50b0fce45b-iptables-alerter-script\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977441    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab97df3-2bde-4621-9b49-ae50b0fce45b-host-slash\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977466    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-slash\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977492    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-var-lib-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977516    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovn-node-metrics-cert\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977627 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977540    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-script-lib\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.977887 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.977565    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-host\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:11.978193 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.978170    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.978457 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.978439    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-ovn\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.978523 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.978481    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-log-socket\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:11.978787 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.978767    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 20 21:48:11.981195 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.981161    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9rrx"
May 20 21:48:11.981283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.981248    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985392    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985409    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985420    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985452    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985402    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:11.985649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985459    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-75lfq\""
May 20 21:48:11.985972 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.985713    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 20 21:48:11.987706 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.987687    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:11.990082 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990062    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 20 21:48:11.990187 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990160    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 20 21:48:11.990281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990265    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 20 21:48:11.990345 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990270    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 20 21:48:11.990382 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990350    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 20 21:48:11.990437 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990385    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 20 21:48:11.990490 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990482    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7btkm\""
May 20 21:48:11.990535 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990515    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lgfpl\""
May 20 21:48:11.990574 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:11.990560    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jdz7z\""
May 20 21:48:12.011820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.011800    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:11 +0000 UTC" deadline="2027-11-22 21:04:36.046526309 +0000 UTC"
May 20 21:48:12.011898 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.011821    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13223h16m24.034708702s"
May 20 21:48:12.068279 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.068256    2523 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 20 21:48:12.079429 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079399    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-etc-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079436    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-node-log\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079472    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079503    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-host\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079506    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-node-log\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079511    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-etc-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079524    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-hostroot\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079553    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-multus-certs\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079576    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079586    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-etc-kubernetes\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079608    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-bin\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079632    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-sys-fs\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079651    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079654    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-bin\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079665    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35268b42-1b17-424e-b1c9-c9cab65aa1bb-hosts-file\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079680    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-systemd\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079713    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-tmp\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.079769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079742    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-systemd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079788    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-systemd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079827    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079828    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-systemd\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079848    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvkpk\" (UniqueName: \"kubernetes.io/projected/69f19b4e-ad32-4085-8f69-7e5974cda1e0-kube-api-access-pvkpk\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079865    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-systemd-units\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079871    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079880    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-os-release\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079906    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cni-binary-copy\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079947    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-systemd-units\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079956    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zwf\" (UniqueName: \"kubernetes.io/projected/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kube-api-access-p8zwf\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.079985    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-conf\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080008    2523 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080029    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ab97df3-2bde-4621-9b49-ae50b0fce45b-iptables-alerter-script\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080060    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab97df3-2bde-4621-9b49-ae50b0fce45b-host-slash\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080080    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-script-lib\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080109    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-bin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.080137 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080133    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2jnq\" (UniqueName: \"kubernetes.io/projected/3d6fcbe4-5c57-451a-81ca-f9383808b527-kube-api-access-c2jnq\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080140    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-conf\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080134    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ab97df3-2bde-4621-9b49-ae50b0fce45b-host-slash\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080167    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-log-socket\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080222    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-run\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080245    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-sys\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080266    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-lib-modules\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080277    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-run\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080293    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-log-socket\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080318    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bq2hq\" (UniqueName: \"kubernetes.io/projected/6ab97df3-2bde-4621-9b49-ae50b0fce45b-kube-api-access-bq2hq\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080333    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-sys\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080341    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-kubelet\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080364    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-konnectivity-ca\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080405    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-lib-modules\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080404    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-socket-dir-parent\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080442    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35268b42-1b17-424e-b1c9-c9cab65aa1bb-tmp-dir\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080447    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-kubelet\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.080780 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080498    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-system-cni-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080524    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csmpp\" (UniqueName: \"kubernetes.io/projected/8bc77ccf-531c-4efa-a911-79792f21fdd5-kube-api-access-csmpp\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080585    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqzd2\" (UniqueName: \"kubernetes.io/projected/56807105-68b2-46ee-a006-514b96328190-kube-api-access-pqzd2\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080629    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-script-lib\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080615    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-agent-certs\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080712    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-serviceca\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080743    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-netns\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080770    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-daemon-config\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080784    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmgpk\" (UniqueName: \"kubernetes.io/projected/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-kube-api-access-kmgpk\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.081337 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.080874    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.081707 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081386    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-var-lib-kubelet\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.081707 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081402    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ab97df3-2bde-4621-9b49-ae50b0fce45b-iptables-alerter-script\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.081707 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081483    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-var-lib-kubelet\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.081837 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081746    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-netns\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.081915 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081897    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-run-netns\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.081988 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081950    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-config\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.081988 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.081983    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-env-overrides\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.082079 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082022    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.082144 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082103    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082188    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4f5\" (UniqueName: \"kubernetes.io/projected/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-kube-api-access-cv4f5\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082211    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-kubelet\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082238    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082268    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082296    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-etc-tuned\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082339    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-k8s-cni-cncf-io\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082362    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082391    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-kubernetes\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082448    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-slash\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082476    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-var-lib-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082520    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovn-node-metrics-cert\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082575    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cnibin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082725    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-multus\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082761    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-socket-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082816    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t8t9\" (UniqueName: \"kubernetes.io/projected/35268b42-1b17-424e-b1c9-c9cab65aa1bb-kube-api-access-5t8t9\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082865    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-host\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.083614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082893    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082920    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-ovn\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.082961    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-conf-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083014    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-registration-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083048    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083078    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-netd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083133    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-system-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083158    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-device-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083187    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-os-release\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083255    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-var-lib-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083282    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysconfig\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083329    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083358    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083390    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-cnibin\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083472    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-modprobe-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083681    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-modprobe-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.083879    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-tmp\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.084388 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.084036    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-cni-netd\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.085111 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.084214    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysconfig\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.085111 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.084815    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-sysctl-d\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.085111 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.084904    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-env-overrides\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.085111 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.085028    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-etc-kubernetes\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.085111 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.085102    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-host-slash\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.085761 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.085151    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-openvswitch\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.085761 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.085235    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/69f19b4e-ad32-4085-8f69-7e5974cda1e0-run-ovn\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.085761 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.085259    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56807105-68b2-46ee-a006-514b96328190-host\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.086577 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.086546    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovn-node-metrics-cert\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.087469 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.087402    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/56807105-68b2-46ee-a006-514b96328190-etc-tuned\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.088278 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.088250    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/69f19b4e-ad32-4085-8f69-7e5974cda1e0-ovnkube-config\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.089550 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.089515    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:12.089550 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.089541    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:12.089550 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.089554    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:12.089736 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.089630    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:12.589594016 +0000 UTC m=+3.033860712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:12.089805 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.089767    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqzd2\" (UniqueName: \"kubernetes.io/projected/56807105-68b2-46ee-a006-514b96328190-kube-api-access-pqzd2\") pod \"tuned-sl8mm\" (UID: \"56807105-68b2-46ee-a006-514b96328190\") " pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.089805 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.089776    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq2hq\" (UniqueName: \"kubernetes.io/projected/6ab97df3-2bde-4621-9b49-ae50b0fce45b-kube-api-access-bq2hq\") pod \"iptables-alerter-nzzzf\" (UID: \"6ab97df3-2bde-4621-9b49-ae50b0fce45b\") " pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.090926 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.090886    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvkpk\" (UniqueName: \"kubernetes.io/projected/69f19b4e-ad32-4085-8f69-7e5974cda1e0-kube-api-access-pvkpk\") pod \"ovnkube-node-dsx9x\" (UID: \"69f19b4e-ad32-4085-8f69-7e5974cda1e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.184265 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184224    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t8t9\" (UniqueName: \"kubernetes.io/projected/35268b42-1b17-424e-b1c9-c9cab65aa1bb-kube-api-access-5t8t9\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184273    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-conf-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184290    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-registration-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184328    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-system-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184346    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-device-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184362    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-os-release\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184377    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184391    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184392    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-conf-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184411    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-registration-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184428    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-system-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184434    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-cnibin\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184406    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-cnibin\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184477    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-cni-dir\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184485    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-os-release\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184486    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-etc-selinux\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184501    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-host\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184531    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-hostroot\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184547    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-host\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184502    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-device-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184556    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-multus-certs\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184584    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-hostroot\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184591    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-etc-kubernetes\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184591    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-multus-certs\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184629    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-etc-kubernetes\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184665    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-sys-fs\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.184798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184698    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184710    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-sys-fs\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184725    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35268b42-1b17-424e-b1c9-c9cab65aa1bb-hosts-file\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184755    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-os-release\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184778    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cni-binary-copy\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184804    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zwf\" (UniqueName: \"kubernetes.io/projected/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kube-api-access-p8zwf\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184819    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35268b42-1b17-424e-b1c9-c9cab65aa1bb-hosts-file\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.184830    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184834    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-bin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184859    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2jnq\" (UniqueName: \"kubernetes.io/projected/3d6fcbe4-5c57-451a-81ca-f9383808b527-kube-api-access-c2jnq\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.184879    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:12.684863339 +0000 UTC m=+3.129130020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184903    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-konnectivity-ca\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184919    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-socket-dir-parent\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184957    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35268b42-1b17-424e-b1c9-c9cab65aa1bb-tmp-dir\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.184981    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-system-cni-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185002    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-csmpp\" (UniqueName: \"kubernetes.io/projected/8bc77ccf-531c-4efa-a911-79792f21fdd5-kube-api-access-csmpp\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185021    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-agent-certs\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.185657 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185043    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-serviceca\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185064    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-netns\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185081    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-daemon-config\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185100    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmgpk\" (UniqueName: \"kubernetes.io/projected/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-kube-api-access-kmgpk\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185119    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185138    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185160    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185186    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4f5\" (UniqueName: \"kubernetes.io/projected/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-kube-api-access-cv4f5\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185207    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-kubelet\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185221    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185240    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-k8s-cni-cncf-io\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185251    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-bin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185259    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185282    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cnibin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185297    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-multus\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185311    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-socket-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185316    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-os-release\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.186322 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185343    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cni-binary-copy\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185485    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185656    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-k8s-cni-cncf-io\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185676    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-run-netns\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.185720    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-kubelet\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186091    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-serviceca\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186083    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186135    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35268b42-1b17-424e-b1c9-c9cab65aa1bb-tmp-dir\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186154    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-konnectivity-ca\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186159    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-system-cni-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186208    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-host-var-lib-cni-multus\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186216    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-socket-dir-parent\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186220    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-cnibin\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186239    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc77ccf-531c-4efa-a911-79792f21fdd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186290    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-socket-dir\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186307    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-multus-daemon-config\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186741    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.187036 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.186768    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc77ccf-531c-4efa-a911-79792f21fdd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.188290 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.188272    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2785f6b2-6fd6-41a5-afd0-388cf8cfacdc-agent-certs\") pod \"konnectivity-agent-rfdl8\" (UID: \"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc\") " pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.196331 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.196307    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2jnq\" (UniqueName: \"kubernetes.io/projected/3d6fcbe4-5c57-451a-81ca-f9383808b527-kube-api-access-c2jnq\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.196582 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.196559    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csmpp\" (UniqueName: \"kubernetes.io/projected/8bc77ccf-531c-4efa-a911-79792f21fdd5-kube-api-access-csmpp\") pod \"multus-additional-cni-plugins-47gqf\" (UID: \"8bc77ccf-531c-4efa-a911-79792f21fdd5\") " pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.197144 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.197119    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmgpk\" (UniqueName: \"kubernetes.io/projected/dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0-kube-api-access-kmgpk\") pod \"multus-t9rrx\" (UID: \"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0\") " pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.197309 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.197286    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4f5\" (UniqueName: \"kubernetes.io/projected/d31fdb6e-6620-40cd-b00b-d66aeeb33eb3-kube-api-access-cv4f5\") pod \"node-ca-htjt7\" (UID: \"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3\") " pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.198037 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.198015    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t8t9\" (UniqueName: \"kubernetes.io/projected/35268b42-1b17-424e-b1c9-c9cab65aa1bb-kube-api-access-5t8t9\") pod \"node-resolver-pvlst\" (UID: \"35268b42-1b17-424e-b1c9-c9cab65aa1bb\") " pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.198120 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.198057    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zwf\" (UniqueName: \"kubernetes.io/projected/e7bc9f9d-05e0-4c90-99a1-a37e20738d95-kube-api-access-p8zwf\") pod \"aws-ebs-csi-driver-node-xgqzs\" (UID: \"e7bc9f9d-05e0-4c90-99a1-a37e20738d95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.209958 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.209871    2523 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 20 21:48:12.272873 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.272850    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sl8mm"
May 20 21:48:12.282480 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.282463    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nzzzf"
May 20 21:48:12.291185 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.291144    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:12.294765 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.294747    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:12.300395 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.300376    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs"
May 20 21:48:12.306956 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.306920    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htjt7"
May 20 21:48:12.312491 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.312471    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9rrx"
May 20 21:48:12.319001 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.318983    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pvlst"
May 20 21:48:12.325499 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.325479    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-47gqf"
May 20 21:48:12.517797 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.517775    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31fdb6e_6620_40cd_b00b_d66aeeb33eb3.slice/crio-c8231392a241dd9d3f6016ab140a7758424687f9d07b2b015570bfceae919df8 WatchSource:0}: Error finding container c8231392a241dd9d3f6016ab140a7758424687f9d07b2b015570bfceae919df8: Status 404 returned error can't find the container with id c8231392a241dd9d3f6016ab140a7758424687f9d07b2b015570bfceae919df8
May 20 21:48:12.520089 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.520059    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc77ccf_531c_4efa_a911_79792f21fdd5.slice/crio-0cdaa454dd84a7ecaed107431ccd4d8b0ae68ce894100328245a87f7576abc53 WatchSource:0}: Error finding container 0cdaa454dd84a7ecaed107431ccd4d8b0ae68ce894100328245a87f7576abc53: Status 404 returned error can't find the container with id 0cdaa454dd84a7ecaed107431ccd4d8b0ae68ce894100328245a87f7576abc53
May 20 21:48:12.520893 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.520434    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35268b42_1b17_424e_b1c9_c9cab65aa1bb.slice/crio-0d059c53c6f5a98db858eff9c20116d06b6f4e5c9c29a4b3c8d3dcd0403a1c9a WatchSource:0}: Error finding container 0d059c53c6f5a98db858eff9c20116d06b6f4e5c9c29a4b3c8d3dcd0403a1c9a: Status 404 returned error can't find the container with id 0d059c53c6f5a98db858eff9c20116d06b6f4e5c9c29a4b3c8d3dcd0403a1c9a
May 20 21:48:12.523452 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.523422    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56807105_68b2_46ee_a006_514b96328190.slice/crio-eb3a51bd05380479112d62419156280b7d2563fd650877d6fdaaead292f8dc45 WatchSource:0}: Error finding container eb3a51bd05380479112d62419156280b7d2563fd650877d6fdaaead292f8dc45: Status 404 returned error can't find the container with id eb3a51bd05380479112d62419156280b7d2563fd650877d6fdaaead292f8dc45
May 20 21:48:12.525958 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.524987    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4d3a0d_d1f1_4fbd_8f54_9e58714a9ef0.slice/crio-701fffad9f25129b4aa37d39ab354a80f90e542b21d4a5658e586f5efa6ecc9c WatchSource:0}: Error finding container 701fffad9f25129b4aa37d39ab354a80f90e542b21d4a5658e586f5efa6ecc9c: Status 404 returned error can't find the container with id 701fffad9f25129b4aa37d39ab354a80f90e542b21d4a5658e586f5efa6ecc9c
May 20 21:48:12.527268 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.527243    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bc9f9d_05e0_4c90_99a1_a37e20738d95.slice/crio-e4eb91b202085a3ec2e9329dd79dbcd10e63a448211489fd75750a98aa74e955 WatchSource:0}: Error finding container e4eb91b202085a3ec2e9329dd79dbcd10e63a448211489fd75750a98aa74e955: Status 404 returned error can't find the container with id e4eb91b202085a3ec2e9329dd79dbcd10e63a448211489fd75750a98aa74e955
May 20 21:48:12.528047 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:12.528025    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2785f6b2_6fd6_41a5_afd0_388cf8cfacdc.slice/crio-fab919815b5e090388f3df4aab1840928c94a5f5fc9426b79fa1d3d94f3c26c3 WatchSource:0}: Error finding container fab919815b5e090388f3df4aab1840928c94a5f5fc9426b79fa1d3d94f3c26c3: Status 404 returned error can't find the container with id fab919815b5e090388f3df4aab1840928c94a5f5fc9426b79fa1d3d94f3c26c3
May 20 21:48:12.689665 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.689642    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:12.689793 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:12.689692    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:12.689839 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689787    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:12.689839 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689799    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:12.689839 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689816    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:12.689839 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689827    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:12.690039 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689842    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:13.689827794 +0000 UTC m=+4.134094473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:12.690039 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:12.689863    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:13.689852291 +0000 UTC m=+4.134118970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:13.012462 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.012358    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-19 21:43:11 +0000 UTC" deadline="2028-01-26 08:09:33.196815444 +0000 UTC"
May 20 21:48:13.012462 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.012394    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14770h21m20.184425062s"
May 20 21:48:13.080127 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.080090    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal" event={"ID":"d60309927476571f99020f085b436480","Type":"ContainerStarted","Data":"0861f5e23eb5bdd3f80eec5bbb9195d255250c912f15ff94ccec973c009bdd95"}
May 20 21:48:13.091095 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.091066    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"db2dbf5b5b35e87d1f7a425cddafc23399d88692985a50a27f78fc4e37539036"}
May 20 21:48:13.109080 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.108360    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-201.ec2.internal" podStartSLOduration=2.108342615 podStartE2EDuration="2.108342615s" podCreationTimestamp="2026-05-20 21:48:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:13.108340891 +0000 UTC m=+3.552607586" watchObservedRunningTime="2026-05-20 21:48:13.108342615 +0000 UTC m=+3.552609311"
May 20 21:48:13.124293 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.124262    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rfdl8" event={"ID":"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc","Type":"ContainerStarted","Data":"fab919815b5e090388f3df4aab1840928c94a5f5fc9426b79fa1d3d94f3c26c3"}
May 20 21:48:13.134121 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.134093    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs" event={"ID":"e7bc9f9d-05e0-4c90-99a1-a37e20738d95","Type":"ContainerStarted","Data":"e4eb91b202085a3ec2e9329dd79dbcd10e63a448211489fd75750a98aa74e955"}
May 20 21:48:13.148411 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.148351    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9rrx" event={"ID":"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0","Type":"ContainerStarted","Data":"701fffad9f25129b4aa37d39ab354a80f90e542b21d4a5658e586f5efa6ecc9c"}
May 20 21:48:13.150017 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.149964    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzzzf" event={"ID":"6ab97df3-2bde-4621-9b49-ae50b0fce45b","Type":"ContainerStarted","Data":"7a898dad167d61625ef9744b4d332953b230a01e62197d86dacb49cbc438304d"}
May 20 21:48:13.157110 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.157083    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerStarted","Data":"0cdaa454dd84a7ecaed107431ccd4d8b0ae68ce894100328245a87f7576abc53"}
May 20 21:48:13.161972 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.161910    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htjt7" event={"ID":"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3","Type":"ContainerStarted","Data":"c8231392a241dd9d3f6016ab140a7758424687f9d07b2b015570bfceae919df8"}
May 20 21:48:13.172157 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.172133    2523 generic.go:358] "Generic (PLEG): container finished" podID="52f5d4a55e3a7c7f01b3406996678023" containerID="7d3baae7ff2bd3da705f69306e01a643a66bb3ebfb08c16382472c4b5af1863f" exitCode=0
May 20 21:48:13.172253 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.172192    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal" event={"ID":"52f5d4a55e3a7c7f01b3406996678023","Type":"ContainerDied","Data":"7d3baae7ff2bd3da705f69306e01a643a66bb3ebfb08c16382472c4b5af1863f"}
May 20 21:48:13.193257 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.193231    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sl8mm" event={"ID":"56807105-68b2-46ee-a006-514b96328190","Type":"ContainerStarted","Data":"eb3a51bd05380479112d62419156280b7d2563fd650877d6fdaaead292f8dc45"}
May 20 21:48:13.199809 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.199785    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pvlst" event={"ID":"35268b42-1b17-424e-b1c9-c9cab65aa1bb","Type":"ContainerStarted","Data":"0d059c53c6f5a98db858eff9c20116d06b6f4e5c9c29a4b3c8d3dcd0403a1c9a"}
May 20 21:48:13.714008 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.713899    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:13.714008 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:13.713972    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:13.714213 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714093    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:13.714213 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714151    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:15.714134025 +0000 UTC m=+6.158400703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:13.714374 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714268    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:13.714374 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714304    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:13.714374 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714318    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:13.714512 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:13.714386    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:15.714372933 +0000 UTC m=+6.158639613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:14.071979 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:14.071887    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:14.072391 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:14.072053    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:14.072391 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:14.072102    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:14.072391 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:14.072233    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:14.214051 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:14.214014    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal" event={"ID":"52f5d4a55e3a7c7f01b3406996678023","Type":"ContainerStarted","Data":"f28b12e9dd57d325cb82a4c1eb4526820cd67ee2be4da7285f5367b01ffe0fd2"}
May 20 21:48:14.228364 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:14.228313    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-201.ec2.internal" podStartSLOduration=3.228295867 podStartE2EDuration="3.228295867s" podCreationTimestamp="2026-05-20 21:48:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:48:14.227434736 +0000 UTC m=+4.671701437" watchObservedRunningTime="2026-05-20 21:48:14.228295867 +0000 UTC m=+4.672562569"
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:15.730815    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731077    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:15.731084    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731103    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731119    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731174    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.731155696 +0000 UTC m=+10.175422384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731209    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:15.731289 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:15.731263    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.73124734 +0000 UTC m=+10.175514036 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:16.072084 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:16.072055    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:16.072238 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:16.072212    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:16.072802 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:16.072665    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:16.072802 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:16.072765    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:18.004521 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.004486    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dm6qf"]
May 20 21:48:18.013816 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.013791    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.013975 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.013868    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:18.072963 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.072337    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:18.072963 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.072462    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:18.072963 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.072845    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:18.072963 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.072948    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:18.149530 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.149502    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.149677 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.149600    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-dbus\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.149677 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.149630    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-kubelet-config\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.250431 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.250398    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-dbus\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.250584 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.250446    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-kubelet-config\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.250584 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.250483    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.250700 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.250629    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:18.250700 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.250684    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:18.750666725 +0000 UTC m=+9.194933413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:18.251077 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.251051    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-dbus\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.251211 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.251115    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7be092c0-dc6d-422a-bc0f-0e32d65106e0-kubelet-config\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.755612 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:18.755168    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:18.755612 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.755281    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:18.755612 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:18.755334    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:19.755321336 +0000 UTC m=+10.199588017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:19.763056 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:19.763027    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:19.763056 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:19.763060    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:19.763082    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763190    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763192    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763204    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763222    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763233    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763244    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.763227001 +0000 UTC m=+18.207493696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763261    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:21.76325354 +0000 UTC m=+12.207520222 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:19.763504 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:19.763276    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:27.763268971 +0000 UTC m=+18.207535654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:20.073384 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:20.073308    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:20.073533 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:20.073411    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:20.073533 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:20.073430    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:20.073533 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:20.073460    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:20.074374 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:20.074344    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:20.074477 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:20.074395    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:21.778291 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:21.778258    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:21.778728 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:21.778415    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:21.778728 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:21.778492    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:25.778470849 +0000 UTC m=+16.222737528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:22.072103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:22.072028    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:22.072254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:22.072028    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:22.072254 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:22.072141    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:22.072254 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:22.072029    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:22.072254 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:22.072240    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:22.072405 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:22.072310    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:24.072347 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:24.072317    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:24.072347 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:24.072340    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:24.072792 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:24.072317    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:24.072792 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:24.072425    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:24.072792 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:24.072481    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:24.072792 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:24.072571    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:25.813507 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:25.813471    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:25.814071 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:25.813622    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:25.814071 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:25.813685    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:33.813663946 +0000 UTC m=+24.257930631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:26.071673 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:26.071609    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:26.071808 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:26.071609    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:26.071808 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:26.071712    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:26.071887 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:26.071795    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:26.071887 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:26.071609    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:26.071976 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:26.071893    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:27.836752 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:27.836711    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:27.836771    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836878    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836883    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836907    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836921    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836965    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:43.836927714 +0000 UTC m=+34.281194409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:27.837281 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:27.836989    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:48:43.836973029 +0000 UTC m=+34.281239721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:28.072171 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:28.072140    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:28.072312 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:28.072250    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:28.072312 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:28.072258    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:28.072375 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:28.072342    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:28.072375 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:28.072140    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:28.072458 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:28.072437    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:30.072804 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:30.072773    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:30.073270 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:30.072871    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:30.073270 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:30.072988    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:30.073270 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:30.073110    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:30.073270 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:30.073162    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:30.073270 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:30.073227    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:31.246904 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.245289    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rfdl8" event={"ID":"2785f6b2-6fd6-41a5-afd0-388cf8cfacdc","Type":"ContainerStarted","Data":"bbad810da6c0bb6cb0083a0d12116a1dc90c59f653e1e0c6f48c7ea85a475f61"}
May 20 21:48:31.248740 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.248717    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs" event={"ID":"e7bc9f9d-05e0-4c90-99a1-a37e20738d95","Type":"ContainerStarted","Data":"357e1e51e87800e001e92384116fbc9882280bdd48ca73e2d48c26f634af30cc"}
May 20 21:48:31.250452 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.250060    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9rrx" event={"ID":"dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0","Type":"ContainerStarted","Data":"ab4831d87f5be82f021d8e806da520a5a78497daa3bc68bb105760c278d3e44c"}
May 20 21:48:31.251560 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.251533    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="ac3a8def4c37757a6e9112b0d29daf63ee84991c527d7b09382933dfbcaf13dd" exitCode=0
May 20 21:48:31.251658 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.251609    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"ac3a8def4c37757a6e9112b0d29daf63ee84991c527d7b09382933dfbcaf13dd"}
May 20 21:48:31.253844 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.253815    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htjt7" event={"ID":"d31fdb6e-6620-40cd-b00b-d66aeeb33eb3","Type":"ContainerStarted","Data":"c377d8b6f62b2bbeb1cca2831a1d10bfa35956fd305f25523303ea96481fe955"}
May 20 21:48:31.255208 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.255170    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sl8mm" event={"ID":"56807105-68b2-46ee-a006-514b96328190","Type":"ContainerStarted","Data":"55e1f9188c3c225b3b238458efca6834e90faaaccc8d85844b84df4b2c8c6dbf"}
May 20 21:48:31.256624 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.256605    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pvlst" event={"ID":"35268b42-1b17-424e-b1c9-c9cab65aa1bb","Type":"ContainerStarted","Data":"b77f8da647f0b55fbe7d28723062b642b4265549f224ac0b1caebbb66058f027"}
May 20 21:48:31.268113 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.268071    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rfdl8" podStartSLOduration=7.379085752 podStartE2EDuration="21.268056959s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.532355668 +0000 UTC m=+2.976622346" lastFinishedPulling="2026-05-20 21:48:26.421326874 +0000 UTC m=+16.865593553" observedRunningTime="2026-05-20 21:48:31.267875237 +0000 UTC m=+21.712141938" watchObservedRunningTime="2026-05-20 21:48:31.268056959 +0000 UTC m=+21.712323660"
May 20 21:48:31.311608 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.311561    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-htjt7" podStartSLOduration=7.41008018 podStartE2EDuration="21.311544667s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.519870109 +0000 UTC m=+2.964136789" lastFinishedPulling="2026-05-20 21:48:26.421334583 +0000 UTC m=+16.865601276" observedRunningTime="2026-05-20 21:48:31.28400034 +0000 UTC m=+21.728267038" watchObservedRunningTime="2026-05-20 21:48:31.311544667 +0000 UTC m=+21.755811367"
May 20 21:48:31.311716 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.311691    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t9rrx" podStartSLOduration=3.192852261 podStartE2EDuration="21.31168506s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.527366664 +0000 UTC m=+2.971633343" lastFinishedPulling="2026-05-20 21:48:30.646199448 +0000 UTC m=+21.090466142" observedRunningTime="2026-05-20 21:48:31.311135308 +0000 UTC m=+21.755402008" watchObservedRunningTime="2026-05-20 21:48:31.31168506 +0000 UTC m=+21.755951761"
May 20 21:48:31.346621 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.346581    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sl8mm" podStartSLOduration=3.267243006 podStartE2EDuration="21.346568428s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.525462757 +0000 UTC m=+2.969729435" lastFinishedPulling="2026-05-20 21:48:30.604788174 +0000 UTC m=+21.049054857" observedRunningTime="2026-05-20 21:48:31.330225318 +0000 UTC m=+21.774492017" watchObservedRunningTime="2026-05-20 21:48:31.346568428 +0000 UTC m=+21.790835128"
May 20 21:48:31.346905 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:31.346878    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pvlst" podStartSLOduration=3.270681182 podStartE2EDuration="21.346872806s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.523609009 +0000 UTC m=+2.967875688" lastFinishedPulling="2026-05-20 21:48:30.599800625 +0000 UTC m=+21.044067312" observedRunningTime="2026-05-20 21:48:31.346388088 +0000 UTC m=+21.790654786" watchObservedRunningTime="2026-05-20 21:48:31.346872806 +0000 UTC m=+21.791139505"
May 20 21:48:32.033459 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.033225    2523 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 20 21:48:32.043042 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.042924    2523 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-20T21:48:32.033459269Z","UUID":"5d142c3d-742a-438e-acd1-9aaefc21d849","Handler":null,"Name":"","Endpoint":""}
May 20 21:48:32.044804 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.044761    2523 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 20 21:48:32.044804 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.044789    2523 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 20 21:48:32.072565 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.072544    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:32.072680 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:32.072649    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:32.073270 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.073064    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:32.073270 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:32.073234    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:32.073423 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.073288    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:32.073423 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:32.073355    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:32.260767 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.260698    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261013    2523 generic.go:358] "Generic (PLEG): container finished" podID="69f19b4e-ad32-4085-8f69-7e5974cda1e0" containerID="f19a936c1e863c3357f67be13b3383682a73f7c720cbca8b97aefa90a17a6f71" exitCode=1
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261083    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"fd02a0e09cd9d8c46338015464d7420ff2eaead48ba39c4ed7e53a6d285734b4"}
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261111    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"a68925c2d4ffc6be2d3129c7f3150433a863fc3b27e937bfa014dd4dba4b6dc9"}
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261124    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"1bcb060e1f9f331cb3992fa93533a7a2e9810784bb4c9d7f64acb584cd45994f"}
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261132    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"6921e0c4b6ab6897f1b0dff9640c1aaacf33733015ada35f99e4f5e506246097"}
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261140    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerDied","Data":"f19a936c1e863c3357f67be13b3383682a73f7c720cbca8b97aefa90a17a6f71"}
May 20 21:48:32.261281 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.261149    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"291476214a7a49fba20c23cdec381976f423c2fd771a0d7b8d776056f52cd372"}
May 20 21:48:32.262844 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.262819    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs" event={"ID":"e7bc9f9d-05e0-4c90-99a1-a37e20738d95","Type":"ContainerStarted","Data":"188a88fb18e51c52597d4b649aa8d727f383374778fcb14874d2907afa601155"}
May 20 21:48:32.264331 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:32.264240    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nzzzf" event={"ID":"6ab97df3-2bde-4621-9b49-ae50b0fce45b","Type":"ContainerStarted","Data":"f3cc225449baf1d592fe32fa3b9a0d8a93a102d34cf0aaf3aaa78d1a73b49a0c"}
May 20 21:48:33.889018 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:33.888983    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:33.889645 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:33.889145    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 20 21:48:33.889645 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:33.889209    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret podName:7be092c0-dc6d-422a-bc0f-0e32d65106e0 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:49.889192525 +0000 UTC m=+40.333459203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret") pod "global-pull-secret-syncer-dm6qf" (UID: "7be092c0-dc6d-422a-bc0f-0e32d65106e0") : object "kube-system"/"original-pull-secret" not registered
May 20 21:48:34.072524 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.072491    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:34.072682 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.072506    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:34.072748 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:34.072731    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:34.072799 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:34.072618    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:34.072799 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.072772    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:34.072886 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:34.072849    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:34.270445 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.270372    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs" event={"ID":"e7bc9f9d-05e0-4c90-99a1-a37e20738d95","Type":"ContainerStarted","Data":"98f5a4812dd7bb0606c71c874fa2bfe2ab7422a0e34811a5dda2a6c3b27cbdb2"}
May 20 21:48:34.289754 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.289707    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nzzzf" podStartSLOduration=6.212659619 podStartE2EDuration="24.289693266s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.523281622 +0000 UTC m=+2.967548303" lastFinishedPulling="2026-05-20 21:48:30.600315257 +0000 UTC m=+21.044581950" observedRunningTime="2026-05-20 21:48:32.293098215 +0000 UTC m=+22.737364914" watchObservedRunningTime="2026-05-20 21:48:34.289693266 +0000 UTC m=+24.733959966"
May 20 21:48:34.289977 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:34.289947    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xgqzs" podStartSLOduration=3.610165184 podStartE2EDuration="24.28992664s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.532315133 +0000 UTC m=+2.976581811" lastFinishedPulling="2026-05-20 21:48:33.212076577 +0000 UTC m=+23.656343267" observedRunningTime="2026-05-20 21:48:34.289276631 +0000 UTC m=+24.733543332" watchObservedRunningTime="2026-05-20 21:48:34.28992664 +0000 UTC m=+24.734193338"
May 20 21:48:35.198433 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:35.198401    2523 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:35.199324 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:35.199304    2523 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:36.072012 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.071705    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:36.072123 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.071709    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:36.072123 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:36.072079    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:36.072230 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:36.072166    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:36.072230 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.071709    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:36.072321 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:36.072267    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:36.276161 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.276142    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:48:36.276518 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.276502    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"96d1e9928f821b65aa1627318ab70b6085ba6b9425235e97e2a880bb91e66eaa"}
May 20 21:48:36.277974 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.277950    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="27cb21425fa1460173bb2bd76322e62e2c32d6ba24862b7e3829ca34f8644550" exitCode=0
May 20 21:48:36.278064 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:36.277990    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"27cb21425fa1460173bb2bd76322e62e2c32d6ba24862b7e3829ca34f8644550"}
May 20 21:48:37.280755 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:37.280731    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerStarted","Data":"6b3d9e4afb279163947ef588da8c8537dd68883ebdacdf040fbcb23f16dcaedd"}
May 20 21:48:38.072465 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.072438    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:38.072598 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.072438    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:38.072598 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:38.072531    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:38.072693 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:38.072598    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:38.072693 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.072448    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:38.072693 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:38.072682    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:38.285255 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.285234    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:48:38.285622 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.285604    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"37f31162f3c256f2624a18c13b2bfc2a56299c812318feea15d532c963b04bae"}
May 20 21:48:38.286537 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.285972    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:38.286537 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.286000    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:38.286537 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.286095    2523 scope.go:117] "RemoveContainer" containerID="f19a936c1e863c3357f67be13b3383682a73f7c720cbca8b97aefa90a17a6f71"
May 20 21:48:38.287857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.287834    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="6b3d9e4afb279163947ef588da8c8537dd68883ebdacdf040fbcb23f16dcaedd" exitCode=0
May 20 21:48:38.287957 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.287878    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"6b3d9e4afb279163947ef588da8c8537dd68883ebdacdf040fbcb23f16dcaedd"}
May 20 21:48:38.304828 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:38.304813    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:39.293349 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.293202    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:48:39.293715 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.293645    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" event={"ID":"69f19b4e-ad32-4085-8f69-7e5974cda1e0","Type":"ContainerStarted","Data":"193be5585bac6e7f6fefd114614c8872395238d90849249d5cd86c2d427446cd"}
May 20 21:48:39.293872 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.293852    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:39.307952 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.307918    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:48:39.324782 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.324587    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x" podStartSLOduration=10.643151134 podStartE2EDuration="29.324568518s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.531699363 +0000 UTC m=+2.975966041" lastFinishedPulling="2026-05-20 21:48:31.213116733 +0000 UTC m=+21.657383425" observedRunningTime="2026-05-20 21:48:39.324510912 +0000 UTC m=+29.768777613" watchObservedRunningTime="2026-05-20 21:48:39.324568518 +0000 UTC m=+29.768835217"
May 20 21:48:39.610638 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.610614    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xxqq"]
May 20 21:48:39.610747 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.610728    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:39.610828 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:39.610809    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:39.612963 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.612916    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm6qf"]
May 20 21:48:39.613072 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.613054    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:39.613176 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:39.613150    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:39.626287 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.626266    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrlgc"]
May 20 21:48:39.626392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:39.626379    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:39.626498 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:39.626480    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:40.297509 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:40.297474    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="6ba1f3d6dd9f4ce5ea9a3dd3c5ca41fa4a79f90528c3a672381cb8c2fac7958c" exitCode=0
May 20 21:48:40.298171 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:40.297560    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"6ba1f3d6dd9f4ce5ea9a3dd3c5ca41fa4a79f90528c3a672381cb8c2fac7958c"}
May 20 21:48:40.449110 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:40.449053    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:40.449215 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:40.449149    2523 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 20 21:48:40.449564 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:40.449546    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rfdl8"
May 20 21:48:41.072461 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:41.072428    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:41.072635 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:41.072464    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:41.072635 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:41.072478    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:41.072635 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:41.072561    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:41.072797 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:41.072652    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:41.072797 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:41.072764    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:43.072045 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.072013    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:43.072529 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.072105    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4xxqq" podUID="a498a60a-9c12-4d47-afb4-5354b35703bf"
May 20 21:48:43.072529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.072022    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:43.072529 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.072184    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:48:43.072529 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.072013    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:43.072529 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.072262    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dm6qf" podUID="7be092c0-dc6d-422a-bc0f-0e32d65106e0"
May 20 21:48:43.366989 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.366773    2523 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-201.ec2.internal" event="NodeReady"
May 20 21:48:43.367120 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.367027    2523 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 20 21:48:43.407681 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.407654    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:48:43.411978 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.411882    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"]
May 20 21:48:43.412293 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.412269    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.415686 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.414620    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 20 21:48:43.415686 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.414921    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 20 21:48:43.417154 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.417136    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"]
May 20 21:48:43.417289 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.417273    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.418062 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.418046    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8st6\""
May 20 21:48:43.420545 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.420529    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"]
May 20 21:48:43.420682 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.420666    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.424093 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.424074    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"]
May 20 21:48:43.424222 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.424212    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.427956 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.427925    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.436968 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.436899    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 20 21:48:43.436968 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.436954    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 20 21:48:43.437142 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.436959    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 20 21:48:43.437142 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.436963    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 20 21:48:43.437142 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.437067    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 20 21:48:43.438099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.438079    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-75bxb\""
May 20 21:48:43.438482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.438079    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 20 21:48:43.438482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.438306    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 20 21:48:43.439072 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.439055    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"]
May 20 21:48:43.441526 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.441260    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"]
May 20 21:48:43.442044 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.442024    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 20 21:48:43.442256 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.442237    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 20 21:48:43.442623 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.442607    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 20 21:48:43.442781 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.442767    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 20 21:48:43.442956 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.442921    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 20 21:48:43.460479 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.460457    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 20 21:48:43.460968 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.460927    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fnpss"]
May 20 21:48:43.463467 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463447    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.463575 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463480    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.463575 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463521    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj44f\" (UniqueName: \"kubernetes.io/projected/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-kube-api-access-cj44f\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.463575 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463547    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.463731 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463572    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-tmp\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.463731 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463608    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.463731 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463630    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.463731 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463675    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.463731 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463701    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-988pm\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463733    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979543e-d67e-4817-aa94-14938d8b0ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463763    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463792    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463847    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdc8z\" (UniqueName: \"kubernetes.io/projected/1979543e-d67e-4817-aa94-14938d8b0ea8-kube-api-access-rdc8z\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463880    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.463994 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463908    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.463999    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.464025    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.464078    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.464104    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6brc\" (UniqueName: \"kubernetes.io/projected/52518ad7-2fb9-430e-866b-57f82ca1f2b1-kube-api-access-q6brc\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.464139    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a217db-5731-499f-96c4-f41fb227fe7a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.464219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.464155    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.465232 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.465219    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.468746 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.468726    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:48:43.469604 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.469585    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6wxr9"]
May 20 21:48:43.469910 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.469888    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 20 21:48:43.470093 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.470071    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 20 21:48:43.470748 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.470589    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 20 21:48:43.472082 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.472055    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\""
May 20 21:48:43.474962 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.474926    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.478288 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.478269    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\""
May 20 21:48:43.478760 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.478743    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"]
May 20 21:48:43.479160 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.479135    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 20 21:48:43.481776 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.481493    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 20 21:48:43.490782 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.490765    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnpss"]
May 20 21:48:43.502112 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.502095    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wxr9"]
May 20 21:48:43.521856 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.521832    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"]
May 20 21:48:43.565211 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565186    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565310 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565216    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565310 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565235    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565310 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565259    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565310 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565282    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-tmp\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565306    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cj44f\" (UniqueName: \"kubernetes.io/projected/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-kube-api-access-cj44f\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.565342    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.565362    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565364    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565401    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.565418    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.065397127 +0000 UTC m=+34.509663819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565454    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.565513 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565487    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b915e3b0-1702-4393-b027-adb3412143b9-tmp-dir\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565517    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979543e-d67e-4817-aa94-14938d8b0ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565549    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rdc8z\" (UniqueName: \"kubernetes.io/projected/1979543e-d67e-4817-aa94-14938d8b0ea8-kube-api-access-rdc8z\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565579    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565608    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565631    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565670    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6brc\" (UniqueName: \"kubernetes.io/projected/52518ad7-2fb9-430e-866b-57f82ca1f2b1-kube-api-access-q6brc\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565698    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a217db-5731-499f-96c4-f41fb227fe7a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565722    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565767    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565792    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565821    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.565857    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-988pm\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.565903 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.565459    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:43.566863 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.566844    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.566947 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.566914    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr7tm\" (UniqueName: \"kubernetes.io/projected/f3c43b80-d572-4582-bf3b-6f346ac0ca09-kube-api-access-sr7tm\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.566988 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.566967    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.066949867 +0000 UTC m=+34.511216549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:43.568243 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.568217    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfmh\" (UniqueName: \"kubernetes.io/projected/b915e3b0-1702-4393-b027-adb3412143b9-kube-api-access-mcfmh\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.568593 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.568567    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-tmp\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.569593 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.569554    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.569832    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b8a217db-5731-499f-96c4-f41fb227fe7a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570079    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1979543e-d67e-4817-aa94-14938d8b0ea8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570143    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570195    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570242    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.570379 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570318    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.570683 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.570502    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b915e3b0-1702-4393-b027-adb3412143b9-config-volume\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.574376 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.572893    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.575236 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.574626    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.575236 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.575081    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-klusterlet-config\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.575813 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.575779    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.575906 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.575890    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.576163 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.575662    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-ca\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.576567 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.576544    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/52518ad7-2fb9-430e-866b-57f82ca1f2b1-hub\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.580437 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.580416    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-988pm\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.580754 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.580722    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdc8z\" (UniqueName: \"kubernetes.io/projected/1979543e-d67e-4817-aa94-14938d8b0ea8-kube-api-access-rdc8z\") pod \"managed-serviceaccount-addon-agent-684bcccdd8-wwfzz\" (UID: \"1979543e-d67e-4817-aa94-14938d8b0ea8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.580927 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.580902    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:43.581205 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.581183    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6brc\" (UniqueName: \"kubernetes.io/projected/52518ad7-2fb9-430e-866b-57f82ca1f2b1-kube-api-access-q6brc\") pod \"cluster-proxy-proxy-agent-db67cb95c-ksw2w\" (UID: \"52518ad7-2fb9-430e-866b-57f82ca1f2b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.581889 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.581867    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj44f\" (UniqueName: \"kubernetes.io/projected/29175cd5-0d1f-4b35-9deb-0b1537d7d1e6-kube-api-access-cj44f\") pod \"klusterlet-addon-workmgr-64657444f-89l66\" (UID: \"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.671797 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.671694    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b915e3b0-1702-4393-b027-adb3412143b9-config-volume\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.671925 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.671801    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.671925 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.671825    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b915e3b0-1702-4393-b027-adb3412143b9-tmp-dir\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.671925 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.671842    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.671951    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.671966    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.672003    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr7tm\" (UniqueName: \"kubernetes.io/projected/f3c43b80-d572-4582-bf3b-6f346ac0ca09-kube-api-access-sr7tm\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.672015    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.17199715 +0000 UTC m=+34.616263842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.672043    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:44.172034178 +0000 UTC m=+34.616300862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:43.672100 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.672059    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfmh\" (UniqueName: \"kubernetes.io/projected/b915e3b0-1702-4393-b027-adb3412143b9-kube-api-access-mcfmh\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.672357 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.672129    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b915e3b0-1702-4393-b027-adb3412143b9-tmp-dir\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.672357 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.672310    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b915e3b0-1702-4393-b027-adb3412143b9-config-volume\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.681952 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.681909    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr7tm\" (UniqueName: \"kubernetes.io/projected/f3c43b80-d572-4582-bf3b-6f346ac0ca09-kube-api-access-sr7tm\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:43.685319 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.685297    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfmh\" (UniqueName: \"kubernetes.io/projected/b915e3b0-1702-4393-b027-adb3412143b9-kube-api-access-mcfmh\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:43.736339 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.736315    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:43.754069 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.754046    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:48:43.759798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.759780    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:48:43.873157 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.873123    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:43.873271 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:43.873173    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:43.873318 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873288    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 20 21:48:43.873318 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873314    2523 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 20 21:48:43.873404 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873327    2523 projected.go:194] Error preparing data for projected volume kube-api-access-6cdb7 for pod openshift-network-diagnostics/network-check-target-4xxqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:43.873404 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873355    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:43.873404 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873397    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7 podName:a498a60a-9c12-4d47-afb4-5354b35703bf nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.873381958 +0000 UTC m=+66.317648637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6cdb7" (UniqueName: "kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7") pod "network-check-target-4xxqq" (UID: "a498a60a-9c12-4d47-afb4-5354b35703bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 20 21:48:43.873535 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:43.873413    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.8734063 +0000 UTC m=+66.317672978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 20 21:48:44.075190 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:44.075106    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:44.075225    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.075266    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.075329    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.075341    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.075352    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.075337912 +0000 UTC m=+35.519604597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:44.075538 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.075387    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.075371757 +0000 UTC m=+35.519638437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:44.176033 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:44.176000    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:44.176203 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:44.176048    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:44.176203 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.176152    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:44.176309 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.176210    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:44.176309 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.176225    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.176206639 +0000 UTC m=+35.620473337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:44.176309 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:44.176259    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:45.176246721 +0000 UTC m=+35.620513399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:48:45.072287 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.072253    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:45.072425 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.072253    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:48:45.072544 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.072502    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:48:45.074857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.074839    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 20 21:48:45.075836 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.075813    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\""
May 20 21:48:45.076191 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.075844    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 21:48:45.076191 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.075865    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 21:48:45.076191 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.076122    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\""
May 20 21:48:45.076340 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.076324    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 21:48:45.082639 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.082621    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:45.082737 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.082690    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:45.082790 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.082740    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:45.082790 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.082756    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:45.082884 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.082809    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:45.082884 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.082816    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.082797553 +0000 UTC m=+37.527064250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:45.082884 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.082862    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.08285041 +0000 UTC m=+37.527117088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:45.183842 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.183811    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:45.184022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.183877    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:45.184022 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.183984    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:45.184138 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.184031    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:45.184138 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.184045    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.184027831 +0000 UTC m=+37.628294512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:45.184138 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:45.184083    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:47.184066792 +0000 UTC m=+37.628333493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:48:45.767401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.767360    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"]
May 20 21:48:45.768332 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.768313    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"]
May 20 21:48:45.773051 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:45.773030    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"]
May 20 21:48:45.803570 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:45.803546    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52518ad7_2fb9_430e_866b_57f82ca1f2b1.slice/crio-a4967532a45d8c269016ffba0c8ce877cc22c111c06576f7a56bbb166f240d35 WatchSource:0}: Error finding container a4967532a45d8c269016ffba0c8ce877cc22c111c06576f7a56bbb166f240d35: Status 404 returned error can't find the container with id a4967532a45d8c269016ffba0c8ce877cc22c111c06576f7a56bbb166f240d35
May 20 21:48:45.804079 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:45.804060    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29175cd5_0d1f_4b35_9deb_0b1537d7d1e6.slice/crio-ff63cba55e6b23f1cc44679579e870cc5b2b5021236e890ffb17f6341f8801ed WatchSource:0}: Error finding container ff63cba55e6b23f1cc44679579e870cc5b2b5021236e890ffb17f6341f8801ed: Status 404 returned error can't find the container with id ff63cba55e6b23f1cc44679579e870cc5b2b5021236e890ffb17f6341f8801ed
May 20 21:48:45.804718 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:45.804699    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1979543e_d67e_4817_aa94_14938d8b0ea8.slice/crio-2443989291d9dbc7cdd30b9ed005d811efd0a3582d5c49925486ee58d1bb9a7c WatchSource:0}: Error finding container 2443989291d9dbc7cdd30b9ed005d811efd0a3582d5c49925486ee58d1bb9a7c: Status 404 returned error can't find the container with id 2443989291d9dbc7cdd30b9ed005d811efd0a3582d5c49925486ee58d1bb9a7c
May 20 21:48:46.309975 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:46.309948    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerStarted","Data":"2443989291d9dbc7cdd30b9ed005d811efd0a3582d5c49925486ee58d1bb9a7c"}
May 20 21:48:46.310901 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:46.310877    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerStarted","Data":"a4967532a45d8c269016ffba0c8ce877cc22c111c06576f7a56bbb166f240d35"}
May 20 21:48:46.311702 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:46.311686    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerStarted","Data":"ff63cba55e6b23f1cc44679579e870cc5b2b5021236e890ffb17f6341f8801ed"}
May 20 21:48:46.313578 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:46.313558    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="ee4152e1405d3f0950230387e94226dc4bb9e51daac57529219747f7a11103a9" exitCode=0
May 20 21:48:46.313646 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:46.313591    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"ee4152e1405d3f0950230387e94226dc4bb9e51daac57529219747f7a11103a9"}
May 20 21:48:47.105983 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.105926    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:47.106190 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.106036    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:47.106252 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.106192    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:47.106312 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.106252    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.106234984 +0000 UTC m=+41.550501668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:47.106667 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.106647    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:47.106667 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.106669    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:47.106815 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.106712    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.106698152 +0000 UTC m=+41.550964834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:47.209358 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.209321    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:47.209524 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.209374    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:47.209587 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.209549    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:47.209636 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.209601    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.209584623 +0000 UTC m=+41.653851303 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:48:47.210012 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.209993    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:47.210083 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:47.210048    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:51.210030835 +0000 UTC m=+41.654297518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:47.320666 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.320628    2523 generic.go:358] "Generic (PLEG): container finished" podID="8bc77ccf-531c-4efa-a911-79792f21fdd5" containerID="3041c53f3025e06df606d47cb599a49ad3eda3209379c8425abd8e3cf5279f19" exitCode=0
May 20 21:48:47.321221 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:47.320689    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerDied","Data":"3041c53f3025e06df606d47cb599a49ad3eda3209379c8425abd8e3cf5279f19"}
May 20 21:48:48.327894 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:48.327293    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-47gqf" event={"ID":"8bc77ccf-531c-4efa-a911-79792f21fdd5","Type":"ContainerStarted","Data":"0a58c08732499405364f1738bf26636d5dc970f928703ae98241ca3365369836"}
May 20 21:48:48.356298 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:48.356080    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-47gqf" podStartSLOduration=5.04492266 podStartE2EDuration="38.356063934s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:48:12.523338414 +0000 UTC m=+2.967605095" lastFinishedPulling="2026-05-20 21:48:45.834479689 +0000 UTC m=+36.278746369" observedRunningTime="2026-05-20 21:48:48.354980711 +0000 UTC m=+38.799247411" watchObservedRunningTime="2026-05-20 21:48:48.356063934 +0000 UTC m=+38.800330636"
May 20 21:48:49.932725 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:49.932689    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:49.936415 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:49.936390    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7be092c0-dc6d-422a-bc0f-0e32d65106e0-original-pull-secret\") pod \"global-pull-secret-syncer-dm6qf\" (UID: \"7be092c0-dc6d-422a-bc0f-0e32d65106e0\") " pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:50.185085 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:50.185013    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dm6qf"
May 20 21:48:51.141662 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:51.141625    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:51.141714    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.141757    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.141780    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.141837    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.141820925 +0000 UTC m=+49.586087603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.141868    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:51.142099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.141951    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.141915782 +0000 UTC m=+49.586182463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:51.242533 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:51.242507    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:51.242684 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:51.242542    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:51.242684 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.242669    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:51.242684 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.242671    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:51.242812 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.242721    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.242708171 +0000 UTC m=+49.686974849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:48:51.242812 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:51.242734    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:48:59.242728114 +0000 UTC m=+49.686994792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:53.805416 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:53.805393    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dm6qf"]
May 20 21:48:53.807792 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:48:53.807761    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be092c0_dc6d_422a_bc0f_0e32d65106e0.slice/crio-f40c671ec5af1a4965ea16ad89bc12a179c7870e39d65854c64fa03e4d3defd2 WatchSource:0}: Error finding container f40c671ec5af1a4965ea16ad89bc12a179c7870e39d65854c64fa03e4d3defd2: Status 404 returned error can't find the container with id f40c671ec5af1a4965ea16ad89bc12a179c7870e39d65854c64fa03e4d3defd2
May 20 21:48:54.338656 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.338622    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerStarted","Data":"ef06a4512e78604882ed716f139ed709c81eda02e3d2224e16e277aaf2bb6d75"}
May 20 21:48:54.340081 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.340038    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerStarted","Data":"9ff973362925bfbd400e66f9133ea2edd834c4424a3380bd1bab9b0b6c982413"}
May 20 21:48:54.341478 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.341444    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerStarted","Data":"74ca59ab129646d1198999f4fb8931b45e5b13312c36b94f9c38e17986837ba2"}
May 20 21:48:54.341661 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.341643    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:54.342632 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.342607    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm6qf" event={"ID":"7be092c0-dc6d-422a-bc0f-0e32d65106e0","Type":"ContainerStarted","Data":"f40c671ec5af1a4965ea16ad89bc12a179c7870e39d65854c64fa03e4d3defd2"}
May 20 21:48:54.343291 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.343259    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:48:54.374798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.374748    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" podStartSLOduration=27.501578176 podStartE2EDuration="35.374733793s" podCreationTimestamp="2026-05-20 21:48:19 +0000 UTC" firstStartedPulling="2026-05-20 21:48:45.812560761 +0000 UTC m=+36.256827443" lastFinishedPulling="2026-05-20 21:48:53.685716369 +0000 UTC m=+44.129983060" observedRunningTime="2026-05-20 21:48:54.373792622 +0000 UTC m=+44.818059323" watchObservedRunningTime="2026-05-20 21:48:54.374733793 +0000 UTC m=+44.819000494"
May 20 21:48:54.375776 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:54.375734    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" podStartSLOduration=27.493847239 podStartE2EDuration="35.375723543s" podCreationTimestamp="2026-05-20 21:48:19 +0000 UTC" firstStartedPulling="2026-05-20 21:48:45.812497324 +0000 UTC m=+36.256764013" lastFinishedPulling="2026-05-20 21:48:53.694373636 +0000 UTC m=+44.138640317" observedRunningTime="2026-05-20 21:48:54.35590007 +0000 UTC m=+44.800166770" watchObservedRunningTime="2026-05-20 21:48:54.375723543 +0000 UTC m=+44.819990243"
May 20 21:48:58.354447 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:58.354409    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerStarted","Data":"332e2786b70f2961907618ed65f96b3b6e45bf4cd6ea579d5e1f2724a253179c"}
May 20 21:48:58.354803 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:58.354452    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerStarted","Data":"1bd38115597b398e496f298421f2295a0df02cf438f93572e89bd9cb2fbcd526"}
May 20 21:48:58.358718 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:58.357336    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dm6qf" event={"ID":"7be092c0-dc6d-422a-bc0f-0e32d65106e0","Type":"ContainerStarted","Data":"a05039d33aabcacd60706d2c4484d7960c12e427dbbc2e2a1fb10b66e1ad9ce4"}
May 20 21:48:58.375125 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:58.375086    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" podStartSLOduration=26.197824187 podStartE2EDuration="38.3750737s" podCreationTimestamp="2026-05-20 21:48:20 +0000 UTC" firstStartedPulling="2026-05-20 21:48:45.812490629 +0000 UTC m=+36.256757307" lastFinishedPulling="2026-05-20 21:48:57.989740142 +0000 UTC m=+48.434006820" observedRunningTime="2026-05-20 21:48:58.373677365 +0000 UTC m=+48.817944066" watchObservedRunningTime="2026-05-20 21:48:58.3750737 +0000 UTC m=+48.819340400"
May 20 21:48:58.388463 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:58.388421    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dm6qf" podStartSLOduration=36.990223158 podStartE2EDuration="41.388410078s" podCreationTimestamp="2026-05-20 21:48:17 +0000 UTC" firstStartedPulling="2026-05-20 21:48:53.809534635 +0000 UTC m=+44.253801314" lastFinishedPulling="2026-05-20 21:48:58.207721545 +0000 UTC m=+48.651988234" observedRunningTime="2026-05-20 21:48:58.388050678 +0000 UTC m=+48.832317381" watchObservedRunningTime="2026-05-20 21:48:58.388410078 +0000 UTC m=+48.832676819"
May 20 21:48:59.204949 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:59.204912    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:48:59.205084 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:59.204999    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:48:59.205084 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.205037    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:48:59.205084 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.205052    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:48:59.205084 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.205081    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:48:59.205209 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.205103    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.205088849 +0000 UTC m=+65.649355527 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:48:59.205209 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.205120    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.205107639 +0000 UTC m=+65.649374318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:48:59.305589 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:59.305566    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:48:59.305803 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:48:59.305598    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:48:59.305803 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.305689    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:48:59.305803 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.305725    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:48:59.305803 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.305743    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.305727982 +0000 UTC m=+65.749994667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:48:59.305803 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:48:59.305760    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:15.305750126 +0000 UTC m=+65.750016804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:49:11.310317 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:11.310292    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsx9x"
May 20 21:49:15.212814 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.212782    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.212835    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.212911    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.212915    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.212946    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.212985    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.212971485 +0000 UTC m=+97.657238166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:49:15.213200 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.213053    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.21303723 +0000 UTC m=+97.657303911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:49:15.313839 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.313818    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:49:15.313953 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.313917    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:49:15.314014 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.313960    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:49:15.314014 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.314012    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.313998232 +0000 UTC m=+97.758264913 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:49:15.314093 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.314018    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:49:15.314093 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.314061    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:49:47.314049877 +0000 UTC m=+97.758316556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:49:15.917744 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.917723    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:49:15.917849 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.917753    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:49:15.920197 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.920182    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 20 21:49:15.920474 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.920462    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 20 21:49:15.928196 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.928177    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 21:49:15.928236 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:15.928223    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:19.928211701 +0000 UTC m=+130.372478379 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : secret "metrics-daemon-secret" not found
May 20 21:49:15.930273 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.930261    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 20 21:49:15.941231 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.941208    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdb7\" (UniqueName: \"kubernetes.io/projected/a498a60a-9c12-4d47-afb4-5354b35703bf-kube-api-access-6cdb7\") pod \"network-check-target-4xxqq\" (UID: \"a498a60a-9c12-4d47-afb4-5354b35703bf\") " pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:49:15.994574 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:15.994556    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x7hr\""
May 20 21:49:16.002865 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:16.002845    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:49:16.117187 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:16.117156    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4xxqq"]
May 20 21:49:16.120777 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:49:16.120755    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda498a60a_9c12_4d47_afb4_5354b35703bf.slice/crio-a50e66e452cfc46b8249406d0e1400c4690769fb82bc774f909e22fce7dd5f0c WatchSource:0}: Error finding container a50e66e452cfc46b8249406d0e1400c4690769fb82bc774f909e22fce7dd5f0c: Status 404 returned error can't find the container with id a50e66e452cfc46b8249406d0e1400c4690769fb82bc774f909e22fce7dd5f0c
May 20 21:49:16.396150 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:16.396123    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xxqq" event={"ID":"a498a60a-9c12-4d47-afb4-5354b35703bf","Type":"ContainerStarted","Data":"a50e66e452cfc46b8249406d0e1400c4690769fb82bc774f909e22fce7dd5f0c"}
May 20 21:49:19.406459 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:19.406427    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4xxqq" event={"ID":"a498a60a-9c12-4d47-afb4-5354b35703bf","Type":"ContainerStarted","Data":"0e11fa2bf6a5ec2e4a6b87e0c080aa6902c4238925585420e15d1ca1c655e71d"}
May 20 21:49:19.406743 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:19.406558    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:49:19.422553 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:19.422513    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4xxqq" podStartSLOduration=66.904706009 podStartE2EDuration="1m9.422503961s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:49:16.122671985 +0000 UTC m=+66.566938663" lastFinishedPulling="2026-05-20 21:49:18.640469937 +0000 UTC m=+69.084736615" observedRunningTime="2026-05-20 21:49:19.42154694 +0000 UTC m=+69.865813640" watchObservedRunningTime="2026-05-20 21:49:19.422503961 +0000 UTC m=+69.866770660"
May 20 21:49:47.228915 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:47.228880    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:47.228978    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.229033    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.229051    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.229061    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.229121    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.229100082 +0000 UTC m=+161.673366765 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:49:47.229415 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.229143    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.22913284 +0000 UTC m=+161.673399561 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:49:47.329904 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:47.329881    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:49:47.330006 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:47.329989    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:49:47.330046 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.330012    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:49:47.330099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.330063    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:49:47.330099 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.330087    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.330071994 +0000 UTC m=+161.774338690 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:49:47.330179 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:49:47.330103    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:50:51.33009518 +0000 UTC m=+161.774361858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:49:50.410890 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:49:50.410862    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4xxqq"
May 20 21:50:19.955189 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:19.955154    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:50:19.955628 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:19.955279    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 20 21:50:19.955628 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:19.955344    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs podName:3d6fcbe4-5c57-451a-81ca-f9383808b527 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:21.955329914 +0000 UTC m=+252.399596593 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs") pod "network-metrics-daemon-nrlgc" (UID: "3d6fcbe4-5c57-451a-81ca-f9383808b527") : secret "metrics-daemon-secret" not found
May 20 21:50:46.424885 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:46.424840    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5"
May 20 21:50:46.431005 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:46.430982    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d" podUID="b8a217db-5731-499f-96c4-f41fb227fe7a"
May 20 21:50:46.484940 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:46.484915    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fnpss" podUID="f3c43b80-d572-4582-bf3b-6f346ac0ca09"
May 20 21:50:46.490054 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:46.490038    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6wxr9" podUID="b915e3b0-1702-4393-b027-adb3412143b9"
May 20 21:50:46.577681 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:46.577662    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wxr9"
May 20 21:50:46.577773 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:46.577704    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:50:46.577808 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:46.577790    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:50:46.577917 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:46.577903    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:50:48.098845 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:48.098809    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nrlgc" podUID="3d6fcbe4-5c57-451a-81ca-f9383808b527"
May 20 21:50:51.270575 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:51.270540    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:51.270588    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.270670    2523 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.270680    2523 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.270701    2523 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d6b9ddcb-krpcv: secret "image-registry-tls" not found
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.270723    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert podName:b8a217db-5731-499f-96c4-f41fb227fe7a nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.270709866 +0000 UTC m=+283.714976544 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-g7v4d" (UID: "b8a217db-5731-499f-96c4-f41fb227fe7a") : secret "networking-console-plugin-cert" not found
May 20 21:50:51.270920 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.270744    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls podName:d59e768a-e6fb-4f27-815d-86f2721168a5 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.270732756 +0000 UTC m=+283.714999435 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls") pod "image-registry-74d6b9ddcb-krpcv" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5") : secret "image-registry-tls" not found
May 20 21:50:51.370926 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:51.370901    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:50:51.371054 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:51.370948    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:50:51.371054 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.371022    2523 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 20 21:50:51.371054 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.371041    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 20 21:50:51.371146 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.371073    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert podName:f3c43b80-d572-4582-bf3b-6f346ac0ca09 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.371063237 +0000 UTC m=+283.815329915 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert") pod "ingress-canary-fnpss" (UID: "f3c43b80-d572-4582-bf3b-6f346ac0ca09") : secret "canary-serving-cert" not found
May 20 21:50:51.371146 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:50:51.371088    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls podName:b915e3b0-1702-4393-b027-adb3412143b9 nodeName:}" failed. No retries permitted until 2026-05-20 21:52:53.37108126 +0000 UTC m=+283.815347939 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls") pod "dns-default-6wxr9" (UID: "b915e3b0-1702-4393-b027-adb3412143b9") : secret "dns-default-metrics-tls" not found
May 20 21:50:54.342694 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.342619    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" podUID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
May 20 21:50:54.598257 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.598213    2523 generic.go:358] "Generic (PLEG): container finished" podID="1979543e-d67e-4817-aa94-14938d8b0ea8" containerID="9ff973362925bfbd400e66f9133ea2edd834c4424a3380bd1bab9b0b6c982413" exitCode=255
May 20 21:50:54.598332 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.598268    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerDied","Data":"9ff973362925bfbd400e66f9133ea2edd834c4424a3380bd1bab9b0b6c982413"}
May 20 21:50:54.598573 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.598558    2523 scope.go:117] "RemoveContainer" containerID="9ff973362925bfbd400e66f9133ea2edd834c4424a3380bd1bab9b0b6c982413"
May 20 21:50:54.599412 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.599393    2523 generic.go:358] "Generic (PLEG): container finished" podID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6" containerID="74ca59ab129646d1198999f4fb8931b45e5b13312c36b94f9c38e17986837ba2" exitCode=1
May 20 21:50:54.599495 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.599445    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerDied","Data":"74ca59ab129646d1198999f4fb8931b45e5b13312c36b94f9c38e17986837ba2"}
May 20 21:50:54.599707 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:54.599695    2523 scope.go:117] "RemoveContainer" containerID="74ca59ab129646d1198999f4fb8931b45e5b13312c36b94f9c38e17986837ba2"
May 20 21:50:55.602433 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:55.602400    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerStarted","Data":"b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180"}
May 20 21:50:55.603866 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:55.603841    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerStarted","Data":"f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821"}
May 20 21:50:55.604123 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:55.604107    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:50:55.604645 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:55.604630    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:50:58.631305 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:58.631282    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvlst_35268b42-1b17-424e-b1c9-c9cab65aa1bb/dns-node-resolver/0.log"
May 20 21:50:59.630733 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:50:59.630683    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htjt7_d31fdb6e-6620-40cd-b00b-d66aeeb33eb3/node-ca/0.log"
May 20 21:51:02.071612 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:02.071581    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:51:18.772889 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.772857    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7rwgv"]
May 20 21:51:18.775857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.775837    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.781979 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.781957    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 20 21:51:18.783028 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.783011    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 20 21:51:18.783112 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.783012    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4kzp2\""
May 20 21:51:18.784479 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.784458    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 20 21:51:18.787401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.787384    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 20 21:51:18.806007 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.805985    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7rwgv"]
May 20 21:51:18.850874 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.850854    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e995459b-44da-49c4-8542-77d4c92c9454-data-volume\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.850984 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.850947    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e995459b-44da-49c4-8542-77d4c92c9454-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.851037 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.850983    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dnh4\" (UniqueName: \"kubernetes.io/projected/e995459b-44da-49c4-8542-77d4c92c9454-kube-api-access-5dnh4\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.851037 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.851011    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e995459b-44da-49c4-8542-77d4c92c9454-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.851037 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.851035    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e995459b-44da-49c4-8542-77d4c92c9454-crio-socket\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.951922 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.951898    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e995459b-44da-49c4-8542-77d4c92c9454-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.951924    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dnh4\" (UniqueName: \"kubernetes.io/projected/e995459b-44da-49c4-8542-77d4c92c9454-kube-api-access-5dnh4\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.951958    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e995459b-44da-49c4-8542-77d4c92c9454-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.951979    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e995459b-44da-49c4-8542-77d4c92c9454-crio-socket\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.952002    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e995459b-44da-49c4-8542-77d4c92c9454-data-volume\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952166 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.952110    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e995459b-44da-49c4-8542-77d4c92c9454-crio-socket\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952304 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.952290    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e995459b-44da-49c4-8542-77d4c92c9454-data-volume\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.952470 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.952449    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e995459b-44da-49c4-8542-77d4c92c9454-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.954330 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.954314    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e995459b-44da-49c4-8542-77d4c92c9454-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:18.963059 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:18.963042    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dnh4\" (UniqueName: \"kubernetes.io/projected/e995459b-44da-49c4-8542-77d4c92c9454-kube-api-access-5dnh4\") pod \"insights-runtime-extractor-7rwgv\" (UID: \"e995459b-44da-49c4-8542-77d4c92c9454\") " pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:19.083857 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:19.083799    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7rwgv"
May 20 21:51:19.199189 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:19.199162    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7rwgv"]
May 20 21:51:19.201971 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:51:19.201928    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode995459b_44da_49c4_8542_77d4c92c9454.slice/crio-651c2044af01e9e2223d45686d4348622a1c6aae8f8af9ef1cd29635c82bcdb0 WatchSource:0}: Error finding container 651c2044af01e9e2223d45686d4348622a1c6aae8f8af9ef1cd29635c82bcdb0: Status 404 returned error can't find the container with id 651c2044af01e9e2223d45686d4348622a1c6aae8f8af9ef1cd29635c82bcdb0
May 20 21:51:19.651176 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:19.651142    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rwgv" event={"ID":"e995459b-44da-49c4-8542-77d4c92c9454","Type":"ContainerStarted","Data":"8f7361d384ce822226470658a863298c2e12e4c00b6813c9c2ecac71ac504cf0"}
May 20 21:51:19.651301 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:19.651180    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rwgv" event={"ID":"e995459b-44da-49c4-8542-77d4c92c9454","Type":"ContainerStarted","Data":"651c2044af01e9e2223d45686d4348622a1c6aae8f8af9ef1cd29635c82bcdb0"}
May 20 21:51:20.655573 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:20.655534    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rwgv" event={"ID":"e995459b-44da-49c4-8542-77d4c92c9454","Type":"ContainerStarted","Data":"adec20625f847c14ab09228d0703e6a6ab41e1af7f9c9d530fc8a7e210aaeaa9"}
May 20 21:51:21.660584 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:21.660544    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7rwgv" event={"ID":"e995459b-44da-49c4-8542-77d4c92c9454","Type":"ContainerStarted","Data":"ef41271737e580c6b91b31d26834d1ba618f803b29b6c7a479cd9bf056e5ddaf"}
May 20 21:51:21.677769 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:21.677675    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7rwgv" podStartSLOduration=1.516315871 podStartE2EDuration="3.677662067s" podCreationTimestamp="2026-05-20 21:51:18 +0000 UTC" firstStartedPulling="2026-05-20 21:51:19.257358801 +0000 UTC m=+189.701625487" lastFinishedPulling="2026-05-20 21:51:21.418705004 +0000 UTC m=+191.862971683" observedRunningTime="2026-05-20 21:51:21.677463633 +0000 UTC m=+192.121730333" watchObservedRunningTime="2026-05-20 21:51:21.677662067 +0000 UTC m=+192.121928768"
May 20 21:51:34.662255 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.662185    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j9gq5"]
May 20 21:51:34.665410 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.665389    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.668760 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.668740    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 20 21:51:34.668875 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.668799    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 20 21:51:34.669315 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.669300    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 20 21:51:34.669315 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.669312    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 20 21:51:34.669659 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.669643    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 20 21:51:34.670069 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.670056    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 20 21:51:34.682393 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.682372    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tp2js\""
May 20 21:51:34.758598 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758574    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-root\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758697 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758608    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-textfile\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758697 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758633    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758697 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758687    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-wtmp\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758854 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758714    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-metrics-client-ca\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758854 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758743    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758854 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758768    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.758854 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758828    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggswh\" (UniqueName: \"kubernetes.io/projected/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-kube-api-access-ggswh\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.759053 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.758875    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-sys\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860050 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860028    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-metrics-client-ca\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860139 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860055    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860139 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860074    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860139 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860105    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggswh\" (UniqueName: \"kubernetes.io/projected/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-kube-api-access-ggswh\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860295 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860150    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-sys\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860295 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:51:34.860196    2523 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 20 21:51:34.860295 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860249    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-root\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860295 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:51:34.860266    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls podName:d60f18db-791e-429d-a2f0-0c1cee4ab0fd nodeName:}" failed. No retries permitted until 2026-05-20 21:51:35.360244524 +0000 UTC m=+205.804511208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls") pod "node-exporter-j9gq5" (UID: "d60f18db-791e-429d-a2f0-0c1cee4ab0fd") : secret "node-exporter-tls" not found
May 20 21:51:34.860482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860297    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-root\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860299    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-textfile\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860329    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860372    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-wtmp\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860328    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-sys\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860645 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860502    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-wtmp\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860677 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860656    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-textfile\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860708 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860673    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-metrics-client-ca\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.860708 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.860673    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.862620 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.862598    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:34.868649 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:34.868625    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggswh\" (UniqueName: \"kubernetes.io/projected/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-kube-api-access-ggswh\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:35.365274 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:35.365252    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:35.367295 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:35.367273    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d60f18db-791e-429d-a2f0-0c1cee4ab0fd-node-exporter-tls\") pod \"node-exporter-j9gq5\" (UID: \"d60f18db-791e-429d-a2f0-0c1cee4ab0fd\") " pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:35.574432 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:35.574409    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9gq5"
May 20 21:51:35.582075 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:51:35.582048    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60f18db_791e_429d_a2f0_0c1cee4ab0fd.slice/crio-c603888e32ff7c7ba669da7d20bc3f425e26e1e7b766fee13303b5345a3a2fc8 WatchSource:0}: Error finding container c603888e32ff7c7ba669da7d20bc3f425e26e1e7b766fee13303b5345a3a2fc8: Status 404 returned error can't find the container with id c603888e32ff7c7ba669da7d20bc3f425e26e1e7b766fee13303b5345a3a2fc8
May 20 21:51:35.688706 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:35.688654    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9gq5" event={"ID":"d60f18db-791e-429d-a2f0-0c1cee4ab0fd","Type":"ContainerStarted","Data":"c603888e32ff7c7ba669da7d20bc3f425e26e1e7b766fee13303b5345a3a2fc8"}
May 20 21:51:36.692475 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:36.692448    2523 generic.go:358] "Generic (PLEG): container finished" podID="d60f18db-791e-429d-a2f0-0c1cee4ab0fd" containerID="a7e2ecd2ce7e4e7fbfaf6873b3bba395277a57df825c77d238c857930f06da28" exitCode=0
May 20 21:51:36.692791 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:36.692523    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9gq5" event={"ID":"d60f18db-791e-429d-a2f0-0c1cee4ab0fd","Type":"ContainerDied","Data":"a7e2ecd2ce7e4e7fbfaf6873b3bba395277a57df825c77d238c857930f06da28"}
May 20 21:51:37.696006 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:37.695969    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9gq5" event={"ID":"d60f18db-791e-429d-a2f0-0c1cee4ab0fd","Type":"ContainerStarted","Data":"631d56b6cec30abe5b17bc5220869cb4943d253a7a34c3340ca1abc7f1dc538c"}
May 20 21:51:37.696006 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:37.696003    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9gq5" event={"ID":"d60f18db-791e-429d-a2f0-0c1cee4ab0fd","Type":"ContainerStarted","Data":"84044336a19025be029ae473556abf4736f7e95f1517b65ca089bb7faa23aea4"}
May 20 21:51:37.717874 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:37.717832    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j9gq5" podStartSLOduration=2.853027518 podStartE2EDuration="3.717818231s" podCreationTimestamp="2026-05-20 21:51:34 +0000 UTC" firstStartedPulling="2026-05-20 21:51:35.583697778 +0000 UTC m=+206.027964457" lastFinishedPulling="2026-05-20 21:51:36.448488488 +0000 UTC m=+206.892755170" observedRunningTime="2026-05-20 21:51:37.717621109 +0000 UTC m=+208.161887809" watchObservedRunningTime="2026-05-20 21:51:37.717818231 +0000 UTC m=+208.162084930"
May 20 21:51:53.761414 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:51:53.761367    2523 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" podUID="52518ad7-2fb9-430e-866b-57f82ca1f2b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:52:03.760604 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:03.760570    2523 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" podUID="52518ad7-2fb9-430e-866b-57f82ca1f2b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:52:13.761060 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:13.761026    2523 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" podUID="52518ad7-2fb9-430e-866b-57f82ca1f2b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 20 21:52:13.761389 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:13.761098    2523 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w"
May 20 21:52:13.761606 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:13.761574    2523 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"332e2786b70f2961907618ed65f96b3b6e45bf4cd6ea579d5e1f2724a253179c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 20 21:52:13.761655 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:13.761641    2523 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" podUID="52518ad7-2fb9-430e-866b-57f82ca1f2b1" containerName="service-proxy" containerID="cri-o://332e2786b70f2961907618ed65f96b3b6e45bf4cd6ea579d5e1f2724a253179c" gracePeriod=30
May 20 21:52:14.775586 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:14.775563    2523 generic.go:358] "Generic (PLEG): container finished" podID="52518ad7-2fb9-430e-866b-57f82ca1f2b1" containerID="332e2786b70f2961907618ed65f96b3b6e45bf4cd6ea579d5e1f2724a253179c" exitCode=2
May 20 21:52:14.776019 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:14.775634    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerDied","Data":"332e2786b70f2961907618ed65f96b3b6e45bf4cd6ea579d5e1f2724a253179c"}
May 20 21:52:14.776019 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:14.775677    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db67cb95c-ksw2w" event={"ID":"52518ad7-2fb9-430e-866b-57f82ca1f2b1","Type":"ContainerStarted","Data":"935f38f5eeab8a2c9acc35469740effc9847fd1c098f58f996aaef5c7a11c47b"}
May 20 21:52:21.988875 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:21.988839    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:52:21.991161 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:21.991140    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d6fcbe4-5c57-451a-81ca-f9383808b527-metrics-certs\") pod \"network-metrics-daemon-nrlgc\" (UID: \"3d6fcbe4-5c57-451a-81ca-f9383808b527\") " pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:52:22.175283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:22.175260    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5n7z5\""
May 20 21:52:22.183248 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:22.183233    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nrlgc"
May 20 21:52:22.298033 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:22.298003    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nrlgc"]
May 20 21:52:22.301818 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:52:22.301794    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6fcbe4_5c57_451a_81ca_f9383808b527.slice/crio-2fb71d4215b7ff3e416a544576d288d5b0a7861ace8b43f624516717286baeb5 WatchSource:0}: Error finding container 2fb71d4215b7ff3e416a544576d288d5b0a7861ace8b43f624516717286baeb5: Status 404 returned error can't find the container with id 2fb71d4215b7ff3e416a544576d288d5b0a7861ace8b43f624516717286baeb5
May 20 21:52:22.796693 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:22.796652    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlgc" event={"ID":"3d6fcbe4-5c57-451a-81ca-f9383808b527","Type":"ContainerStarted","Data":"2fb71d4215b7ff3e416a544576d288d5b0a7861ace8b43f624516717286baeb5"}
May 20 21:52:23.802464 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:23.802432    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlgc" event={"ID":"3d6fcbe4-5c57-451a-81ca-f9383808b527","Type":"ContainerStarted","Data":"8a2c3cb7253d569572a17955ceae02d7281e16ce1c6e3e35b2182f31b4cd019f"}
May 20 21:52:23.802785 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:23.802473    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nrlgc" event={"ID":"3d6fcbe4-5c57-451a-81ca-f9383808b527","Type":"ContainerStarted","Data":"38a594a92786692addc7badab60a1b4112c6d757dd88b21324ceda98f4d1c6a9"}
May 20 21:52:23.817600 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:23.817552    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nrlgc" podStartSLOduration=252.841979857 podStartE2EDuration="4m13.817535933s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="2026-05-20 21:52:22.303437314 +0000 UTC m=+252.747704006" lastFinishedPulling="2026-05-20 21:52:23.278993395 +0000 UTC m=+253.723260082" observedRunningTime="2026-05-20 21:52:23.817175583 +0000 UTC m=+254.261442283" watchObservedRunningTime="2026-05-20 21:52:23.817535933 +0000 UTC m=+254.261802644"
May 20 21:52:32.800986 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:32.800905    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/init-textfile/0.log"
May 20 21:52:32.991948 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:32.991917    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/node-exporter/0.log"
May 20 21:52:33.190264 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:33.190207    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/kube-rbac-proxy/0.log"
May 20 21:52:40.990582 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:40.990557    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvlst_35268b42-1b17-424e-b1c9-c9cab65aa1bb/dns-node-resolver/0.log"
May 20 21:52:42.194770 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:42.194738    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htjt7_d31fdb6e-6620-40cd-b00b-d66aeeb33eb3/node-ca/0.log"
May 20 21:52:49.578649 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:49.578563    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6wxr9" podUID="b915e3b0-1702-4393-b027-adb3412143b9"
May 20 21:52:49.578649 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:49.578584    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d" podUID="b8a217db-5731-499f-96c4-f41fb227fe7a"
May 20 21:52:49.578649 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:49.578566    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5"
May 20 21:52:49.578649 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:49.578626    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fnpss" podUID="f3c43b80-d572-4582-bf3b-6f346ac0ca09"
May 20 21:52:49.862735 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:49.862713    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:52:49.862844 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:49.862745    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:52:49.862844 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:49.862765    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:52:49.862844 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:49.862829    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wxr9"
May 20 21:52:53.307199 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.307162    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:52:53.307629 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.307256    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:52:53.309538 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.309517    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"image-registry-74d6b9ddcb-krpcv\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") " pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:52:53.309633 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.309560    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b8a217db-5731-499f-96c4-f41fb227fe7a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-g7v4d\" (UID: \"b8a217db-5731-499f-96c4-f41fb227fe7a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:52:53.408261 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.408232    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:52:53.408349 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.408268    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:52:53.410249 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.410230    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b915e3b0-1702-4393-b027-adb3412143b9-metrics-tls\") pod \"dns-default-6wxr9\" (UID: \"b915e3b0-1702-4393-b027-adb3412143b9\") " pod="openshift-dns/dns-default-6wxr9"
May 20 21:52:53.410401 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.410385    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3c43b80-d572-4582-bf3b-6f346ac0ca09-cert\") pod \"ingress-canary-fnpss\" (UID: \"f3c43b80-d572-4582-bf3b-6f346ac0ca09\") " pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:52:53.467079 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.467057    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fk4m\""
May 20 21:52:53.467079 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.467057    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5njn\""
May 20 21:52:53.467182 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.467057    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-75bxb\""
May 20 21:52:53.467182 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.467142    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n8st6\""
May 20 21:52:53.474093 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.474073    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"
May 20 21:52:53.474179 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.474095    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6wxr9"
May 20 21:52:53.474179 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.474072    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:52:53.474273 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.474109    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnpss"
May 20 21:52:53.635475 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.635441    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:52:53.639224 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:52:53.639198    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59e768a_e6fb_4f27_815d_86f2721168a5.slice/crio-1fbdd124ab5bc63f4094c7c75b8d7b27923a5ecfa754e8edf25f2624e97387b2 WatchSource:0}: Error finding container 1fbdd124ab5bc63f4094c7c75b8d7b27923a5ecfa754e8edf25f2624e97387b2: Status 404 returned error can't find the container with id 1fbdd124ab5bc63f4094c7c75b8d7b27923a5ecfa754e8edf25f2624e97387b2
May 20 21:52:53.646311 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.646289    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnpss"]
May 20 21:52:53.649715 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:52:53.649692    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c43b80_d572_4582_bf3b_6f346ac0ca09.slice/crio-f858e940c8a3e12ab4bae541c92ac1d0bbc49abb1b9f9d3ce0462b6572676021 WatchSource:0}: Error finding container f858e940c8a3e12ab4bae541c92ac1d0bbc49abb1b9f9d3ce0462b6572676021: Status 404 returned error can't find the container with id f858e940c8a3e12ab4bae541c92ac1d0bbc49abb1b9f9d3ce0462b6572676021
May 20 21:52:53.872253 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.871855    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6wxr9"]
May 20 21:52:53.874118 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.873862    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnpss" event={"ID":"f3c43b80-d572-4582-bf3b-6f346ac0ca09","Type":"ContainerStarted","Data":"f858e940c8a3e12ab4bae541c92ac1d0bbc49abb1b9f9d3ce0462b6572676021"}
May 20 21:52:53.875249 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.875229    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d"]
May 20 21:52:53.875464 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.875443    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" event={"ID":"d59e768a-e6fb-4f27-815d-86f2721168a5","Type":"ContainerStarted","Data":"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"}
May 20 21:52:53.875534 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.875471    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" event={"ID":"d59e768a-e6fb-4f27-815d-86f2721168a5","Type":"ContainerStarted","Data":"1fbdd124ab5bc63f4094c7c75b8d7b27923a5ecfa754e8edf25f2624e97387b2"}
May 20 21:52:53.875606 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.875591    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:52:53.876018 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:52:53.875997    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb915e3b0_1702_4393_b027_adb3412143b9.slice/crio-04ef6019b20e30e823770c2082a6b034e742e459d0efd24c487ef0fac85993d5 WatchSource:0}: Error finding container 04ef6019b20e30e823770c2082a6b034e742e459d0efd24c487ef0fac85993d5: Status 404 returned error can't find the container with id 04ef6019b20e30e823770c2082a6b034e742e459d0efd24c487ef0fac85993d5
May 20 21:52:53.878545 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:52:53.878522    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a217db_5731_499f_96c4_f41fb227fe7a.slice/crio-a7426388e4b325a802f1a789a0c0ca9f7126bd8832c3fc1f98793d34b615a2a1 WatchSource:0}: Error finding container a7426388e4b325a802f1a789a0c0ca9f7126bd8832c3fc1f98793d34b615a2a1: Status 404 returned error can't find the container with id a7426388e4b325a802f1a789a0c0ca9f7126bd8832c3fc1f98793d34b615a2a1
May 20 21:52:53.899105 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:53.899065    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podStartSLOduration=283.899055025 podStartE2EDuration="4m43.899055025s" podCreationTimestamp="2026-05-20 21:48:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 21:52:53.898225915 +0000 UTC m=+284.342492638" watchObservedRunningTime="2026-05-20 21:52:53.899055025 +0000 UTC m=+284.343321723"
May 20 21:52:54.879552 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:54.879515    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d" event={"ID":"b8a217db-5731-499f-96c4-f41fb227fe7a","Type":"ContainerStarted","Data":"a7426388e4b325a802f1a789a0c0ca9f7126bd8832c3fc1f98793d34b615a2a1"}
May 20 21:52:54.880836 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:54.880799    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wxr9" event={"ID":"b915e3b0-1702-4393-b027-adb3412143b9","Type":"ContainerStarted","Data":"04ef6019b20e30e823770c2082a6b034e742e459d0efd24c487ef0fac85993d5"}
May 20 21:52:55.605423 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.605347    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" podUID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
May 20 21:52:55.885067 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.885035    2523 generic.go:358] "Generic (PLEG): container finished" podID="1979543e-d67e-4817-aa94-14938d8b0ea8" containerID="b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180" exitCode=255
May 20 21:52:55.885482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.885115    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerDied","Data":"b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180"}
May 20 21:52:55.885482 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.885167    2523 scope.go:117] "RemoveContainer" containerID="9ff973362925bfbd400e66f9133ea2edd834c4424a3380bd1bab9b0b6c982413"
May 20 21:52:55.885590 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.885482    2523 scope.go:117] "RemoveContainer" containerID="b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180"
May 20 21:52:55.885719 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:55.885697    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-684bcccdd8-wwfzz_open-cluster-management-agent-addon(1979543e-d67e-4817-aa94-14938d8b0ea8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" podUID="1979543e-d67e-4817-aa94-14938d8b0ea8"
May 20 21:52:55.886728 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.886707    2523 generic.go:358] "Generic (PLEG): container finished" podID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6" containerID="f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821" exitCode=1
May 20 21:52:55.886797 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.886778    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerDied","Data":"f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821"}
May 20 21:52:55.887109 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.887097    2523 scope.go:117] "RemoveContainer" containerID="f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821"
May 20 21:52:55.887253 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:52:55.887239    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64657444f-89l66_open-cluster-management-agent-addon(29175cd5-0d1f-4b35-9deb-0b1537d7d1e6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" podUID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6"
May 20 21:52:55.916539 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:55.916306    2523 scope.go:117] "RemoveContainer" containerID="74ca59ab129646d1198999f4fb8931b45e5b13312c36b94f9c38e17986837ba2"
May 20 21:52:56.890376 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.890336    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d" event={"ID":"b8a217db-5731-499f-96c4-f41fb227fe7a","Type":"ContainerStarted","Data":"2cb76c6a34a42546b083e77d0d27200b41174e897297090d72e3cd732b579f59"}
May 20 21:52:56.891915 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.891889    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wxr9" event={"ID":"b915e3b0-1702-4393-b027-adb3412143b9","Type":"ContainerStarted","Data":"2fa800b1fdb1a0149b89865241d22d254aaa9d6ad100a6c95a2661bc160ec7f7"}
May 20 21:52:56.891915 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.891917    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6wxr9" event={"ID":"b915e3b0-1702-4393-b027-adb3412143b9","Type":"ContainerStarted","Data":"e36e8490b544430c30bc5a3b8a40c4f6d4f3bf37a2d06644f3d9e385446a2205"}
May 20 21:52:56.892122 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.891971    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6wxr9"
May 20 21:52:56.895189 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.895167    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnpss" event={"ID":"f3c43b80-d572-4582-bf3b-6f346ac0ca09","Type":"ContainerStarted","Data":"c52b060380e379518496c82d5d137416dae10479bb57351fec824e934d607ad7"}
May 20 21:52:56.906436 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.906399    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-g7v4d" podStartSLOduration=260.868482333 podStartE2EDuration="4m22.90638792s" podCreationTimestamp="2026-05-20 21:48:34 +0000 UTC" firstStartedPulling="2026-05-20 21:52:53.880261046 +0000 UTC m=+284.324527724" lastFinishedPulling="2026-05-20 21:52:55.918166633 +0000 UTC m=+286.362433311" observedRunningTime="2026-05-20 21:52:56.905071539 +0000 UTC m=+287.349338238" watchObservedRunningTime="2026-05-20 21:52:56.90638792 +0000 UTC m=+287.350654631"
May 20 21:52:56.923810 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.923765    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fnpss" podStartSLOduration=251.658775598 podStartE2EDuration="4m13.923755256s" podCreationTimestamp="2026-05-20 21:48:43 +0000 UTC" firstStartedPulling="2026-05-20 21:52:53.653350099 +0000 UTC m=+284.097616777" lastFinishedPulling="2026-05-20 21:52:55.918329756 +0000 UTC m=+286.362596435" observedRunningTime="2026-05-20 21:52:56.92361125 +0000 UTC m=+287.367877952" watchObservedRunningTime="2026-05-20 21:52:56.923755256 +0000 UTC m=+287.368021956"
May 20 21:52:56.941418 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:52:56.941382    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6wxr9" podStartSLOduration=251.900880364 podStartE2EDuration="4m13.941372849s" podCreationTimestamp="2026-05-20 21:48:43 +0000 UTC" firstStartedPulling="2026-05-20 21:52:53.877890201 +0000 UTC m=+284.322156879" lastFinishedPulling="2026-05-20 21:52:55.918382686 +0000 UTC m=+286.362649364" observedRunningTime="2026-05-20 21:52:56.940785518 +0000 UTC m=+287.385052230" watchObservedRunningTime="2026-05-20 21:52:56.941372849 +0000 UTC m=+287.385639548"
May 20 21:53:03.736805 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:03.736771    2523 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:53:03.737170 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:03.737087    2523 scope.go:117] "RemoveContainer" containerID="f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821"
May 20 21:53:03.737257 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:53:03.737239    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64657444f-89l66_open-cluster-management-agent-addon(29175cd5-0d1f-4b35-9deb-0b1537d7d1e6)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" podUID="29175cd5-0d1f-4b35-9deb-0b1537d7d1e6"
May 20 21:53:03.754532 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:03.754502    2523 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz"
May 20 21:53:03.754786 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:03.754772    2523 scope.go:117] "RemoveContainer" containerID="b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180"
May 20 21:53:03.754923 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:53:03.754908    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-684bcccdd8-wwfzz_open-cluster-management-agent-addon(1979543e-d67e-4817-aa94-14938d8b0ea8)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" podUID="1979543e-d67e-4817-aa94-14938d8b0ea8"
May 20 21:53:05.604386 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:05.604353    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:53:05.604786 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:05.604731    2523 scope.go:117] "RemoveContainer" containerID="f97a6709d13090dcf903a526433bab66ee42d62892e2fe57e1a073cc40f4d821"
May 20 21:53:05.920973 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:05.920928    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66" event={"ID":"29175cd5-0d1f-4b35-9deb-0b1537d7d1e6","Type":"ContainerStarted","Data":"8cfda627da0d513c86a1daefc35c7efe67ae408970f51edb2535f0d9c6dbbacb"}
May 20 21:53:05.921225 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:05.921208    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:53:05.922354 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:05.922333    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64657444f-89l66"
May 20 21:53:06.899665 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:06.899645    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6wxr9"
May 20 21:53:09.985814 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:09.985784    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:53:09.986570 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:09.986545    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:53:09.992757 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:09.992739    2523 kubelet.go:1628] "Image garbage collection succeeded"
May 20 21:53:13.478185 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:13.478153    2523 patch_prober.go:28] interesting pod/image-registry-74d6b9ddcb-krpcv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 20 21:53:13.480478 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:13.478198    2523 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 20 21:53:14.884506 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:14.884477    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:53:16.072745 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:16.072711    2523 scope.go:117] "RemoveContainer" containerID="b399e42aa21b0f5f664839724652a6424aa550400ef58ec8f2a7885208ebf180"
May 20 21:53:16.073711 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:16.073696    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:53:16.952464 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:16.952433    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-684bcccdd8-wwfzz" event={"ID":"1979543e-d67e-4817-aa94-14938d8b0ea8","Type":"ContainerStarted","Data":"dc1ee80c71277a8ec04ca2ab65c207c781c8a9e34f66e48b6d8404b7befaf380"}
May 20 21:53:19.162082 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:19.162051    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:53:44.180017 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:44.179974    2523 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry" containerID="cri-o://fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9" gracePeriod=30
May 20 21:53:44.882245 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:44.882222    2523 patch_prober.go:28] interesting pod/image-registry-74d6b9ddcb-krpcv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.133.0.6:5000/healthz\": dial tcp 10.133.0.6:5000: connect: connection refused" start-of-body=
May 20 21:53:44.882428 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:44.882270    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry" probeResult="failure" output="Get \"https://10.133.0.6:5000/healthz\": dial tcp 10.133.0.6:5000: connect: connection refused"
May 20 21:53:45.406460 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.406439    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:53:45.533870 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533805    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.533870 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533843    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.533870 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533869    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-988pm\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533900    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533927    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533968    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.533991    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.534017    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") pod \"d59e768a-e6fb-4f27-815d-86f2721168a5\" (UID: \"d59e768a-e6fb-4f27-815d-86f2721168a5\") "
May 20 21:53:45.534716 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.534645    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:53:45.536519 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.535978    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:53:45.541251 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.541180    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:53:45.541548 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.541514    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:53:45.541548 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.541519    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:53:45.541721 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.541626    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm" (OuterVolumeSpecName: "kube-api-access-988pm") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "kube-api-access-988pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:53:45.541721 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.541629    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 20 21:53:45.544214 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.544187    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d59e768a-e6fb-4f27-815d-86f2721168a5" (UID: "d59e768a-e6fb-4f27-815d-86f2721168a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:53:45.634499 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634476    2523 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-bound-sa-token\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634499 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634497    2523 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d59e768a-e6fb-4f27-815d-86f2721168a5-ca-trust-extracted\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634506    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-988pm\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-kube-api-access-988pm\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634515    2523 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-installation-pull-secrets\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634524    2523 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-certificates\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634532    2523 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d59e768a-e6fb-4f27-815d-86f2721168a5-trusted-ca\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634540    2523 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d59e768a-e6fb-4f27-815d-86f2721168a5-image-registry-private-configuration\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:45.634610 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:45.634549    2523 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d59e768a-e6fb-4f27-815d-86f2721168a5-registry-tls\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:53:46.021573 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.021548    2523 generic.go:358] "Generic (PLEG): container finished" podID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerID="fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9" exitCode=0
May 20 21:53:46.021679 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.021610    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" event={"ID":"d59e768a-e6fb-4f27-815d-86f2721168a5","Type":"ContainerDied","Data":"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"}
May 20 21:53:46.021679 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.021623    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv"
May 20 21:53:46.021679 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.021645    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d6b9ddcb-krpcv" event={"ID":"d59e768a-e6fb-4f27-815d-86f2721168a5","Type":"ContainerDied","Data":"1fbdd124ab5bc63f4094c7c75b8d7b27923a5ecfa754e8edf25f2624e97387b2"}
May 20 21:53:46.021679 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.021666    2523 scope.go:117] "RemoveContainer" containerID="fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"
May 20 21:53:46.029116 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.029100    2523 scope.go:117] "RemoveContainer" containerID="fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"
May 20 21:53:46.029362 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:53:46.029343    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9\": container with ID starting with fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9 not found: ID does not exist" containerID="fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"
May 20 21:53:46.029416 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.029372    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9"} err="failed to get container status \"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9\": rpc error: code = NotFound desc = could not find container \"fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9\": container with ID starting with fe6a6ab378dbad4f5ef925ec8990eb7ff4afd9c1e8bc6cf3bf4a1a0b5f78f0a9 not found: ID does not exist"
May 20 21:53:46.040798 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.040778    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:53:46.044238 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.044218    2523 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74d6b9ddcb-krpcv"]
May 20 21:53:46.075580 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:53:46.075553    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" path="/var/lib/kubelet/pods/d59e768a-e6fb-4f27-815d-86f2721168a5/volumes"
May 20 21:55:08.407476 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.407447    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"]
May 20 21:55:08.407896 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.407661    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry"
May 20 21:55:08.407896 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.407672    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry"
May 20 21:55:08.407896 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.407717    2523 memory_manager.go:356] "RemoveStaleState removing state" podUID="d59e768a-e6fb-4f27-815d-86f2721168a5" containerName="registry"
May 20 21:55:08.410354 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.410339    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.412621 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.412598    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-crc2t\""
May 20 21:55:08.412723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.412603    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 20 21:55:08.413600 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.413571    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 20 21:55:08.418534 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.418515    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"]
May 20 21:55:08.539026 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.539005    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2d6627-5406-44b1-8d82-e5a3b0807c37-tmp\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.539126 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.539049    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsf6l\" (UniqueName: \"kubernetes.io/projected/cd2d6627-5406-44b1-8d82-e5a3b0807c37-kube-api-access-lsf6l\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.640222 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.640202    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsf6l\" (UniqueName: \"kubernetes.io/projected/cd2d6627-5406-44b1-8d82-e5a3b0807c37-kube-api-access-lsf6l\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.640302 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.640237    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2d6627-5406-44b1-8d82-e5a3b0807c37-tmp\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.640515 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.640498    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2d6627-5406-44b1-8d82-e5a3b0807c37-tmp\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.648067 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.648040    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsf6l\" (UniqueName: \"kubernetes.io/projected/cd2d6627-5406-44b1-8d82-e5a3b0807c37-kube-api-access-lsf6l\") pod \"openshift-lws-operator-bfc7f696d-sg69p\" (UID: \"cd2d6627-5406-44b1-8d82-e5a3b0807c37\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.719030 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.718979    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"
May 20 21:55:08.839263 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:08.839235    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p"]
May 20 21:55:08.842334 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:55:08.842307    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd2d6627_5406_44b1_8d82_e5a3b0807c37.slice/crio-df3b227307b5a6e3ce76ece8d4ea7697858964fc009e1c8a98615e6c33236456 WatchSource:0}: Error finding container df3b227307b5a6e3ce76ece8d4ea7697858964fc009e1c8a98615e6c33236456: Status 404 returned error can't find the container with id df3b227307b5a6e3ce76ece8d4ea7697858964fc009e1c8a98615e6c33236456
May 20 21:55:09.205210 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:09.205178    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p" event={"ID":"cd2d6627-5406-44b1-8d82-e5a3b0807c37","Type":"ContainerStarted","Data":"df3b227307b5a6e3ce76ece8d4ea7697858964fc009e1c8a98615e6c33236456"}
May 20 21:55:13.217214 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:13.217181    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p" event={"ID":"cd2d6627-5406-44b1-8d82-e5a3b0807c37","Type":"ContainerStarted","Data":"7a2206cfbf4dbf4c49f47fbbcfe2a09c356638f874ce9fdab7fac7f705af9fac"}
May 20 21:55:13.238477 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:13.238432    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-sg69p" podStartSLOduration=1.726695759 podStartE2EDuration="5.238414547s" podCreationTimestamp="2026-05-20 21:55:08 +0000 UTC" firstStartedPulling="2026-05-20 21:55:08.843655158 +0000 UTC m=+419.287921836" lastFinishedPulling="2026-05-20 21:55:12.355373942 +0000 UTC m=+422.799640624" observedRunningTime="2026-05-20 21:55:13.236142568 +0000 UTC m=+423.680409268" watchObservedRunningTime="2026-05-20 21:55:13.238414547 +0000 UTC m=+423.682681246"
May 20 21:55:29.724061 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.723979    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"]
May 20 21:55:29.727074 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.727058    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.732031 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.732008    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 20 21:55:29.733177 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.732979    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jb7vn\""
May 20 21:55:29.733177 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.733137    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 20 21:55:29.733404 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.733387    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 20 21:55:29.736653 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.736635    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 20 21:55:29.754173 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.754154    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"]
May 20 21:55:29.878779 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.878756    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.878907 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.878787    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmpch\" (UniqueName: \"kubernetes.io/projected/e3ecb258-f46d-4467-ae6f-e67a72a29658-kube-api-access-xmpch\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.878907 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.878824    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.979446 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.979403    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.979446 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.979434    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.979557 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.979453    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmpch\" (UniqueName: \"kubernetes.io/projected/e3ecb258-f46d-4467-ae6f-e67a72a29658-kube-api-access-xmpch\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.981826 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.981804    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.981989 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.981968    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3ecb258-f46d-4467-ae6f-e67a72a29658-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:29.991303 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:29.991278    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmpch\" (UniqueName: \"kubernetes.io/projected/e3ecb258-f46d-4467-ae6f-e67a72a29658-kube-api-access-xmpch\") pod \"opendatahub-operator-controller-manager-6c897df989-zpfxx\" (UID: \"e3ecb258-f46d-4467-ae6f-e67a72a29658\") " pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:30.036678 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:30.036661    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:30.165965 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:30.165924    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"]
May 20 21:55:30.168477 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:55:30.168448    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ecb258_f46d_4467_ae6f_e67a72a29658.slice/crio-e7c3d55415cd1195ad621a38493ba9f4ac486de4d16f960d5de1d5793a70e91c WatchSource:0}: Error finding container e7c3d55415cd1195ad621a38493ba9f4ac486de4d16f960d5de1d5793a70e91c: Status 404 returned error can't find the container with id e7c3d55415cd1195ad621a38493ba9f4ac486de4d16f960d5de1d5793a70e91c
May 20 21:55:30.257006 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:30.256954    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx" event={"ID":"e3ecb258-f46d-4467-ae6f-e67a72a29658","Type":"ContainerStarted","Data":"e7c3d55415cd1195ad621a38493ba9f4ac486de4d16f960d5de1d5793a70e91c"}
May 20 21:55:33.266787 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:33.266748    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx" event={"ID":"e3ecb258-f46d-4467-ae6f-e67a72a29658","Type":"ContainerStarted","Data":"ea8d6f4679a28a13b287013d83f355b03412ebebd6e66a08f05d240269606a7d"}
May 20 21:55:33.267290 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:33.266875    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:33.289251 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:33.289210    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx" podStartSLOduration=1.95965448 podStartE2EDuration="4.289199441s" podCreationTimestamp="2026-05-20 21:55:29 +0000 UTC" firstStartedPulling="2026-05-20 21:55:30.170075865 +0000 UTC m=+440.614342543" lastFinishedPulling="2026-05-20 21:55:32.499620824 +0000 UTC m=+442.943887504" observedRunningTime="2026-05-20 21:55:33.287347613 +0000 UTC m=+443.731614312" watchObservedRunningTime="2026-05-20 21:55:33.289199441 +0000 UTC m=+443.733466139"
May 20 21:55:44.271465 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:44.271438    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c897df989-zpfxx"
May 20 21:55:49.826711 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.826653    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-dnnk6"]
May 20 21:55:49.832774 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.832759    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:49.835260 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.835235    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-d9ppk\""
May 20 21:55:49.835393 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.835235    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 20 21:55:49.836795 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.836773    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-dnnk6"]
May 20 21:55:49.912223 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.912197    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p447n\" (UniqueName: \"kubernetes.io/projected/f5f38955-763e-4e58-9764-630fc9a7646f-kube-api-access-p447n\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:49.912328 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:49.912236    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.012808 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.012780    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p447n\" (UniqueName: \"kubernetes.io/projected/f5f38955-763e-4e58-9764-630fc9a7646f-kube-api-access-p447n\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.012953 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.012817    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.012953 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:50.012915    2523 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 20 21:55:50.013026 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:50.012981    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert podName:f5f38955-763e-4e58-9764-630fc9a7646f nodeName:}" failed. No retries permitted until 2026-05-20 21:55:50.512966435 +0000 UTC m=+460.957233113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert") pod "odh-model-controller-858dbf95b8-dnnk6" (UID: "f5f38955-763e-4e58-9764-630fc9a7646f") : secret "odh-model-controller-webhook-cert" not found
May 20 21:55:50.023303 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.023282    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p447n\" (UniqueName: \"kubernetes.io/projected/f5f38955-763e-4e58-9764-630fc9a7646f-kube-api-access-p447n\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.516708 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.516674    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.519256 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.519233    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5f38955-763e-4e58-9764-630fc9a7646f-cert\") pod \"odh-model-controller-858dbf95b8-dnnk6\" (UID: \"f5f38955-763e-4e58-9764-630fc9a7646f\") " pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.743633 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.743596    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:55:50.866325 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:50.866299    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-dnnk6"]
May 20 21:55:50.868761 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:55:50.868724    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f38955_763e_4e58_9764_630fc9a7646f.slice/crio-c85c6a6f97726da6c8f10bb7b5127a8e50df94d6253b78d6446e4f4acb369d9a WatchSource:0}: Error finding container c85c6a6f97726da6c8f10bb7b5127a8e50df94d6253b78d6446e4f4acb369d9a: Status 404 returned error can't find the container with id c85c6a6f97726da6c8f10bb7b5127a8e50df94d6253b78d6446e4f4acb369d9a
May 20 21:55:51.311404 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:51.311366    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" event={"ID":"f5f38955-763e-4e58-9764-630fc9a7646f","Type":"ContainerStarted","Data":"c85c6a6f97726da6c8f10bb7b5127a8e50df94d6253b78d6446e4f4acb369d9a"}
May 20 21:55:54.319612 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:54.319577    2523 generic.go:358] "Generic (PLEG): container finished" podID="f5f38955-763e-4e58-9764-630fc9a7646f" containerID="66c9e1d593ad42758b38ddece0185a1bf928db0e94feb1ad765b8d8bdafa710a" exitCode=1
May 20 21:55:54.319972 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:54.319634    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" event={"ID":"f5f38955-763e-4e58-9764-630fc9a7646f","Type":"ContainerDied","Data":"66c9e1d593ad42758b38ddece0185a1bf928db0e94feb1ad765b8d8bdafa710a"}
May 20 21:55:54.319972 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:54.319833    2523 scope.go:117] "RemoveContainer" containerID="66c9e1d593ad42758b38ddece0185a1bf928db0e94feb1ad765b8d8bdafa710a"
May 20 21:55:55.325274 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.325242    2523 generic.go:358] "Generic (PLEG): container finished" podID="f5f38955-763e-4e58-9764-630fc9a7646f" containerID="460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d" exitCode=1
May 20 21:55:55.325723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.325283    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" event={"ID":"f5f38955-763e-4e58-9764-630fc9a7646f","Type":"ContainerDied","Data":"460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d"}
May 20 21:55:55.325723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.325311    2523 scope.go:117] "RemoveContainer" containerID="66c9e1d593ad42758b38ddece0185a1bf928db0e94feb1ad765b8d8bdafa710a"
May 20 21:55:55.325723 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.325518    2523 scope.go:117] "RemoveContainer" containerID="460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d"
May 20 21:55:55.325723 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:55.325700    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-dnnk6_opendatahub(f5f38955-763e-4e58-9764-630fc9a7646f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" podUID="f5f38955-763e-4e58-9764-630fc9a7646f"
May 20 21:55:55.490865 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.490837    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lmsfq"]
May 20 21:55:55.494783 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.494769    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:55.497596 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.497571    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 20 21:55:55.497707 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.497616    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ms4tf\""
May 20 21:55:55.504232 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.504207    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lmsfq"]
May 20 21:55:55.654162 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.654131    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzxn\" (UniqueName: \"kubernetes.io/projected/75e4463d-55a9-45ad-9a4a-37513f2abc00-kube-api-access-8rzxn\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:55.654290 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.654173    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:55.754913 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.754887    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzxn\" (UniqueName: \"kubernetes.io/projected/75e4463d-55a9-45ad-9a4a-37513f2abc00-kube-api-access-8rzxn\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:55.755017 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.754921    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:55.755055 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:55.755018    2523 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 20 21:55:55.755088 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:55.755064    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert podName:75e4463d-55a9-45ad-9a4a-37513f2abc00 nodeName:}" failed. No retries permitted until 2026-05-20 21:55:56.255049801 +0000 UTC m=+466.699316479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert") pod "kserve-controller-manager-856948b99f-lmsfq" (UID: "75e4463d-55a9-45ad-9a4a-37513f2abc00") : secret "kserve-webhook-server-cert" not found
May 20 21:55:55.763971 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:55.763949    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzxn\" (UniqueName: \"kubernetes.io/projected/75e4463d-55a9-45ad-9a4a-37513f2abc00-kube-api-access-8rzxn\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:56.258134 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:56.258097    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:56.260547 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:56.260526    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75e4463d-55a9-45ad-9a4a-37513f2abc00-cert\") pod \"kserve-controller-manager-856948b99f-lmsfq\" (UID: \"75e4463d-55a9-45ad-9a4a-37513f2abc00\") " pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:56.329655 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:56.329633    2523 scope.go:117] "RemoveContainer" containerID="460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d"
May 20 21:55:56.329916 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:55:56.329826    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-dnnk6_opendatahub(f5f38955-763e-4e58-9764-630fc9a7646f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" podUID="f5f38955-763e-4e58-9764-630fc9a7646f"
May 20 21:55:56.405648 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:56.405624    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:55:56.524752 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:56.524659    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-lmsfq"]
May 20 21:55:56.527260 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:55:56.527228    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e4463d_55a9_45ad_9a4a_37513f2abc00.slice/crio-a812bf42a2e65da5423ee1249092099d2fd39c11fa2d08902b0f29c75e0495ff WatchSource:0}: Error finding container a812bf42a2e65da5423ee1249092099d2fd39c11fa2d08902b0f29c75e0495ff: Status 404 returned error can't find the container with id a812bf42a2e65da5423ee1249092099d2fd39c11fa2d08902b0f29c75e0495ff
May 20 21:55:57.334059 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:55:57.334020    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq" event={"ID":"75e4463d-55a9-45ad-9a4a-37513f2abc00","Type":"ContainerStarted","Data":"a812bf42a2e65da5423ee1249092099d2fd39c11fa2d08902b0f29c75e0495ff"}
May 20 21:56:00.343363 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:00.343325    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq" event={"ID":"75e4463d-55a9-45ad-9a4a-37513f2abc00","Type":"ContainerStarted","Data":"81b6e38b73b7dc429af885f663d2af80b1237f3e5b3eb1b2724e0c59626432ce"}
May 20 21:56:00.343772 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:00.343471    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:56:00.360520 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:00.360344    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq" podStartSLOduration=1.727655317 podStartE2EDuration="5.360328517s" podCreationTimestamp="2026-05-20 21:55:55 +0000 UTC" firstStartedPulling="2026-05-20 21:55:56.528585706 +0000 UTC m=+466.972852384" lastFinishedPulling="2026-05-20 21:56:00.161258903 +0000 UTC m=+470.605525584" observedRunningTime="2026-05-20 21:56:00.35999066 +0000 UTC m=+470.804257361" watchObservedRunningTime="2026-05-20 21:56:00.360328517 +0000 UTC m=+470.804595218"
May 20 21:56:00.744567 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:00.744534    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:56:00.745008 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:00.744993    2523 scope.go:117] "RemoveContainer" containerID="460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d"
May 20 21:56:00.745216 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:56:00.745196    2523 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-dnnk6_opendatahub(f5f38955-763e-4e58-9764-630fc9a7646f)\"" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" podUID="f5f38955-763e-4e58-9764-630fc9a7646f"
May 20 21:56:07.900622 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.900583    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"]
May 20 21:56:07.907110 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.907089    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:07.909354 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.909331    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 20 21:56:07.909456 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.909364    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 21:56:07.909456 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.909407    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 20 21:56:07.910222 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.910208    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g5r4p\""
May 20 21:56:07.910272 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.910207    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 20 21:56:07.912677 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:07.912657    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"]
May 20 21:56:08.036973 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.036949    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjv4c\" (UniqueName: \"kubernetes.io/projected/9f811347-6eaf-4cbe-976a-686e26d4c99c-kube-api-access-wjv4c\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.037075 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.036993    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f811347-6eaf-4cbe-976a-686e26d4c99c-tmp\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.037075 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.037026    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f811347-6eaf-4cbe-976a-686e26d4c99c-tls-certs\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.137749 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.137723    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f811347-6eaf-4cbe-976a-686e26d4c99c-tls-certs\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.137848 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.137763    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjv4c\" (UniqueName: \"kubernetes.io/projected/9f811347-6eaf-4cbe-976a-686e26d4c99c-kube-api-access-wjv4c\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.137848 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.137793    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f811347-6eaf-4cbe-976a-686e26d4c99c-tmp\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.140052 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.140032    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f811347-6eaf-4cbe-976a-686e26d4c99c-tmp\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.140251 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.140235    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f811347-6eaf-4cbe-976a-686e26d4c99c-tls-certs\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.144992 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.144974    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjv4c\" (UniqueName: \"kubernetes.io/projected/9f811347-6eaf-4cbe-976a-686e26d4c99c-kube-api-access-wjv4c\") pod \"kube-auth-proxy-6544789b6f-nwcsp\" (UID: \"9f811347-6eaf-4cbe-976a-686e26d4c99c\") " pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.218214 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.218163    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"
May 20 21:56:08.339471 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.339438    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp"]
May 20 21:56:08.342764 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:56:08.342741    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f811347_6eaf_4cbe_976a_686e26d4c99c.slice/crio-52eb8ad1564e89ab17ea4c77d98656900df0447fd4ae224f821ecb3c99eb04cb WatchSource:0}: Error finding container 52eb8ad1564e89ab17ea4c77d98656900df0447fd4ae224f821ecb3c99eb04cb: Status 404 returned error can't find the container with id 52eb8ad1564e89ab17ea4c77d98656900df0447fd4ae224f821ecb3c99eb04cb
May 20 21:56:08.365908 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:08.365883    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp" event={"ID":"9f811347-6eaf-4cbe-976a-686e26d4c99c","Type":"ContainerStarted","Data":"52eb8ad1564e89ab17ea4c77d98656900df0447fd4ae224f821ecb3c99eb04cb"}
May 20 21:56:10.744630 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:10.744604    2523 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:56:10.745056 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:10.744986    2523 scope.go:117] "RemoveContainer" containerID="460346b791513b751ae072d568f57a6682505570e89264120c4ebccfb81a950d"
May 20 21:56:11.079728 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.079705    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 20 21:56:11.376140 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.376109    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" event={"ID":"f5f38955-763e-4e58-9764-630fc9a7646f","Type":"ContainerStarted","Data":"011004e841e4e2e1d2a126ec3ee10e77ed9b443f3c525332474a3cbb2d775a9e"}
May 20 21:56:11.376348 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.376327    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:56:11.377386 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.377365    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp" event={"ID":"9f811347-6eaf-4cbe-976a-686e26d4c99c","Type":"ContainerStarted","Data":"688b7ad9500323e73420c6f93aeaf59ef2253a3879cbdfb00eb0f7f366e15858"}
May 20 21:56:11.404207 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.404162    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6" podStartSLOduration=2.201971341 podStartE2EDuration="22.404145377s" podCreationTimestamp="2026-05-20 21:55:49 +0000 UTC" firstStartedPulling="2026-05-20 21:55:50.86998624 +0000 UTC m=+461.314252918" lastFinishedPulling="2026-05-20 21:56:11.072160272 +0000 UTC m=+481.516426954" observedRunningTime="2026-05-20 21:56:11.403593386 +0000 UTC m=+481.847860085" watchObservedRunningTime="2026-05-20 21:56:11.404145377 +0000 UTC m=+481.848412079"
May 20 21:56:11.446155 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:11.446102    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6544789b6f-nwcsp" podStartSLOduration=1.7130455009999999 podStartE2EDuration="4.446086241s" podCreationTimestamp="2026-05-20 21:56:07 +0000 UTC" firstStartedPulling="2026-05-20 21:56:08.344426307 +0000 UTC m=+478.788693000" lastFinishedPulling="2026-05-20 21:56:11.077467047 +0000 UTC m=+481.521733740" observedRunningTime="2026-05-20 21:56:11.444869182 +0000 UTC m=+481.889135881" watchObservedRunningTime="2026-05-20 21:56:11.446086241 +0000 UTC m=+481.890352943"
May 20 21:56:22.382569 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:22.382539    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-dnnk6"
May 20 21:56:23.227081 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.227052    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"]
May 20 21:56:23.269051 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.269006    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"]
May 20 21:56:23.269239 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.269209    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.272049 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.272025    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 20 21:56:23.272049 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.272038    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 20 21:56:23.272049 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.272025    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-drhxm\""
May 20 21:56:23.341808 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.341783    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s57l\" (UniqueName: \"kubernetes.io/projected/a71fa48b-4f12-4ddb-942e-a9008d5785f8-kube-api-access-2s57l\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.341916 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.341822    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a71fa48b-4f12-4ddb-942e-a9008d5785f8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.442440 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.442415    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2s57l\" (UniqueName: \"kubernetes.io/projected/a71fa48b-4f12-4ddb-942e-a9008d5785f8-kube-api-access-2s57l\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.442797 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.442460    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a71fa48b-4f12-4ddb-942e-a9008d5785f8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.445029 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.445010    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a71fa48b-4f12-4ddb-942e-a9008d5785f8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.450660 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.450609    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s57l\" (UniqueName: \"kubernetes.io/projected/a71fa48b-4f12-4ddb-942e-a9008d5785f8-kube-api-access-2s57l\") pod \"servicemesh-operator3-55f49c5f94-fkfpq\" (UID: \"a71fa48b-4f12-4ddb-942e-a9008d5785f8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.578133 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.578085    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:23.710646 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:23.710615    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"]
May 20 21:56:23.713716 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:56:23.713691    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71fa48b_4f12_4ddb_942e_a9008d5785f8.slice/crio-133a3749ff956661314ec238c17084a1f0da81b5a865b242c5a00aae645c2009 WatchSource:0}: Error finding container 133a3749ff956661314ec238c17084a1f0da81b5a865b242c5a00aae645c2009: Status 404 returned error can't find the container with id 133a3749ff956661314ec238c17084a1f0da81b5a865b242c5a00aae645c2009
May 20 21:56:24.413548 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:24.413517    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq" event={"ID":"a71fa48b-4f12-4ddb-942e-a9008d5785f8","Type":"ContainerStarted","Data":"133a3749ff956661314ec238c17084a1f0da81b5a865b242c5a00aae645c2009"}
May 20 21:56:27.424240 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:27.424212    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq" event={"ID":"a71fa48b-4f12-4ddb-942e-a9008d5785f8","Type":"ContainerStarted","Data":"61fbd736dff8035f0884b6e64f87f8b1c76b59fdc6aca823787a5568ff79a47d"}
May 20 21:56:27.424598 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:27.424318    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:27.446074 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:27.446034    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq" podStartSLOduration=1.539334015 podStartE2EDuration="4.446019606s" podCreationTimestamp="2026-05-20 21:56:23 +0000 UTC" firstStartedPulling="2026-05-20 21:56:23.716133863 +0000 UTC m=+494.160400542" lastFinishedPulling="2026-05-20 21:56:26.622819451 +0000 UTC m=+497.067086133" observedRunningTime="2026-05-20 21:56:27.444254575 +0000 UTC m=+497.888521275" watchObservedRunningTime="2026-05-20 21:56:27.446019606 +0000 UTC m=+497.890286308"
May 20 21:56:31.350563 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:31.350535    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-lmsfq"
May 20 21:56:33.627372 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.627341    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"]
May 20 21:56:33.629288 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.629267    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.633673 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.633640    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 20 21:56:33.633809 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.633695    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 20 21:56:33.633809 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.633640    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 20 21:56:33.633910 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.633845    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 20 21:56:33.634446 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.634426    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c5sxj\""
May 20 21:56:33.642884 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.642865    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"]
May 20 21:56:33.710650 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710625    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710750 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710659    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710750 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710687    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkz4f\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-kube-api-access-bkz4f\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710750 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710709    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88dfcb76-2b69-43bd-90f9-df83825148a5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710845 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710779    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710845 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710807    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.710845 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.710832    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.811829 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.811807    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.811924 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.811837    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.811924 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.811870    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bkz4f\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-kube-api-access-bkz4f\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.811924 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.811900    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88dfcb76-2b69-43bd-90f9-df83825148a5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.812084 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.811976    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.812084 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.812001    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.812392 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.812366    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.812545 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.812452    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.814478 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.814459    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.814738 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.814720    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/88dfcb76-2b69-43bd-90f9-df83825148a5-local-certs\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.814800 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.814727    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-cacerts\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.814852 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.814822    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.821684 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.821663    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-istio-token\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.822213 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.822193    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkz4f\" (UniqueName: \"kubernetes.io/projected/88dfcb76-2b69-43bd-90f9-df83825148a5-kube-api-access-bkz4f\") pod \"istiod-openshift-gateway-798958bb55-7bljs\" (UID: \"88dfcb76-2b69-43bd-90f9-df83825148a5\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:33.939167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:33.939101    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:34.071480 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:34.071395    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"]
May 20 21:56:34.074547 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:56:34.074519    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88dfcb76_2b69_43bd_90f9_df83825148a5.slice/crio-efc2f509e4913c5ef6a1933315d0c55fb3a089ae1c631a896a2c94ec75315584 WatchSource:0}: Error finding container efc2f509e4913c5ef6a1933315d0c55fb3a089ae1c631a896a2c94ec75315584: Status 404 returned error can't find the container with id efc2f509e4913c5ef6a1933315d0c55fb3a089ae1c631a896a2c94ec75315584
May 20 21:56:34.447343 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:34.447307    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs" event={"ID":"88dfcb76-2b69-43bd-90f9-df83825148a5","Type":"ContainerStarted","Data":"efc2f509e4913c5ef6a1933315d0c55fb3a089ae1c631a896a2c94ec75315584"}
May 20 21:56:37.078037 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:37.077995    2523 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 20 21:56:37.078323 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:37.078065    2523 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
May 20 21:56:37.460661 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:37.460074    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs" event={"ID":"88dfcb76-2b69-43bd-90f9-df83825148a5","Type":"ContainerStarted","Data":"b7255de23d4df76b965dae0503790188fc1ec39bc2eddc06bd10545b35ebdf7a"}
May 20 21:56:37.460661 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:37.460390    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:56:37.484429 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:37.484363    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs" podStartSLOduration=1.483416871 podStartE2EDuration="4.484344479s" podCreationTimestamp="2026-05-20 21:56:33 +0000 UTC" firstStartedPulling="2026-05-20 21:56:34.076841504 +0000 UTC m=+504.521108183" lastFinishedPulling="2026-05-20 21:56:37.077769113 +0000 UTC m=+507.522035791" observedRunningTime="2026-05-20 21:56:37.482636995 +0000 UTC m=+507.926903695" watchObservedRunningTime="2026-05-20 21:56:37.484344479 +0000 UTC m=+507.928611190"
May 20 21:56:38.428949 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:38.428905    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-fkfpq"
May 20 21:56:38.466067 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:56:38.466039    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-7bljs"
May 20 21:57:31.338499 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.338428    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-hf8hh"]
May 20 21:57:31.341094 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.341078    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:31.343495 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.343476    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 20 21:57:31.344475 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.344457    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5brzq\""
May 20 21:57:31.344563 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.344457    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 20 21:57:31.350301 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.350281    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-hf8hh"]
May 20 21:57:31.397684 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.397660    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgwx\" (UniqueName: \"kubernetes.io/projected/9a83132f-5bf3-4fe6-b975-cafcc809dac8-kube-api-access-5pgwx\") pod \"authorino-operator-657f44b778-hf8hh\" (UID: \"9a83132f-5bf3-4fe6-b975-cafcc809dac8\") " pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:31.498836 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.498814    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgwx\" (UniqueName: \"kubernetes.io/projected/9a83132f-5bf3-4fe6-b975-cafcc809dac8-kube-api-access-5pgwx\") pod \"authorino-operator-657f44b778-hf8hh\" (UID: \"9a83132f-5bf3-4fe6-b975-cafcc809dac8\") " pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:31.515019 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.514993    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgwx\" (UniqueName: \"kubernetes.io/projected/9a83132f-5bf3-4fe6-b975-cafcc809dac8-kube-api-access-5pgwx\") pod \"authorino-operator-657f44b778-hf8hh\" (UID: \"9a83132f-5bf3-4fe6-b975-cafcc809dac8\") " pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:31.650987 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.650967    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:31.778384 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:31.778362    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-hf8hh"]
May 20 21:57:31.780779 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:57:31.780755    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a83132f_5bf3_4fe6_b975_cafcc809dac8.slice/crio-7b6a0b9b96c47563f565b618ccd7f1486d4ff9209160415b76758074d7a2062e WatchSource:0}: Error finding container 7b6a0b9b96c47563f565b618ccd7f1486d4ff9209160415b76758074d7a2062e: Status 404 returned error can't find the container with id 7b6a0b9b96c47563f565b618ccd7f1486d4ff9209160415b76758074d7a2062e
May 20 21:57:32.614371 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:32.614336    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh" event={"ID":"9a83132f-5bf3-4fe6-b975-cafcc809dac8","Type":"ContainerStarted","Data":"7b6a0b9b96c47563f565b618ccd7f1486d4ff9209160415b76758074d7a2062e"}
May 20 21:57:33.618715 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:33.618690    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh" event={"ID":"9a83132f-5bf3-4fe6-b975-cafcc809dac8","Type":"ContainerStarted","Data":"8a2833da22196927815b0e97db3fa623f9d66ce609015b97c66b50ea16a77616"}
May 20 21:57:33.619009 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:33.618805    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:33.641949 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:33.641891    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh" podStartSLOduration=0.876615794 podStartE2EDuration="2.641879954s" podCreationTimestamp="2026-05-20 21:57:31 +0000 UTC" firstStartedPulling="2026-05-20 21:57:31.782648895 +0000 UTC m=+562.226915573" lastFinishedPulling="2026-05-20 21:57:33.547913054 +0000 UTC m=+563.992179733" observedRunningTime="2026-05-20 21:57:33.640239035 +0000 UTC m=+564.084505756" watchObservedRunningTime="2026-05-20 21:57:33.641879954 +0000 UTC m=+564.086146658"
May 20 21:57:39.442546 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.442512    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"]
May 20 21:57:39.445890 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.445867    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:39.448496 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.448478    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 20 21:57:39.448677 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.448660    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kpd7s\""
May 20 21:57:39.454148 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.454125    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"]
May 20 21:57:39.553402 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.553379    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49sp\" (UniqueName: \"kubernetes.io/projected/4a341d70-b8e3-4976-803f-77d31e0717c0-kube-api-access-g49sp\") pod \"dns-operator-controller-manager-648d5c98bc-gq78p\" (UID: \"4a341d70-b8e3-4976-803f-77d31e0717c0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:39.654119 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.654097    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g49sp\" (UniqueName: \"kubernetes.io/projected/4a341d70-b8e3-4976-803f-77d31e0717c0-kube-api-access-g49sp\") pod \"dns-operator-controller-manager-648d5c98bc-gq78p\" (UID: \"4a341d70-b8e3-4976-803f-77d31e0717c0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:39.666989 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.666972    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49sp\" (UniqueName: \"kubernetes.io/projected/4a341d70-b8e3-4976-803f-77d31e0717c0-kube-api-access-g49sp\") pod \"dns-operator-controller-manager-648d5c98bc-gq78p\" (UID: \"4a341d70-b8e3-4976-803f-77d31e0717c0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:39.756116 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.756065    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:39.880438 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:39.880416    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"]
May 20 21:57:39.882561 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:57:39.882531    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a341d70_b8e3_4976_803f_77d31e0717c0.slice/crio-d67c9cb7f96e953e4d35b4953d0e2a8870ba301be6235e8f91201d20d633ea2a WatchSource:0}: Error finding container d67c9cb7f96e953e4d35b4953d0e2a8870ba301be6235e8f91201d20d633ea2a: Status 404 returned error can't find the container with id d67c9cb7f96e953e4d35b4953d0e2a8870ba301be6235e8f91201d20d633ea2a
May 20 21:57:40.640300 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:40.640264    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p" event={"ID":"4a341d70-b8e3-4976-803f-77d31e0717c0","Type":"ContainerStarted","Data":"d67c9cb7f96e953e4d35b4953d0e2a8870ba301be6235e8f91201d20d633ea2a"}
May 20 21:57:42.652567 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:42.652530    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p" event={"ID":"4a341d70-b8e3-4976-803f-77d31e0717c0","Type":"ContainerStarted","Data":"a7db93b56dad274f8b094d66d49c4d572e6a923e2010703b72eb42dc4c086834"}
May 20 21:57:42.653019 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:42.652674    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:42.676196 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:42.676132    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p" podStartSLOduration=1.4109838 podStartE2EDuration="3.676116947s" podCreationTimestamp="2026-05-20 21:57:39 +0000 UTC" firstStartedPulling="2026-05-20 21:57:39.884426925 +0000 UTC m=+570.328693603" lastFinishedPulling="2026-05-20 21:57:42.149560072 +0000 UTC m=+572.593826750" observedRunningTime="2026-05-20 21:57:42.674920717 +0000 UTC m=+573.119187428" watchObservedRunningTime="2026-05-20 21:57:42.676116947 +0000 UTC m=+573.120383648"
May 20 21:57:44.624058 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:44.624032    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-hf8hh"
May 20 21:57:53.658233 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.658202    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-gq78p"
May 20 21:57:53.723412 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.723381    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"]
May 20 21:57:53.726536 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.726521    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.729080 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.729056    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j65r2\""
May 20 21:57:53.738327 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.738306    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"]
May 20 21:57:53.855365 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.855340    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cntb\" (UniqueName: \"kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.855477 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.855376    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.956521 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.956458    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cntb\" (UniqueName: \"kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.956521 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.956503    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.956809 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.956794    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:53.969022 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:53.969001    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cntb\" (UniqueName: \"kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb\") pod \"kuadrant-operator-controller-manager-84b657d985-h4nws\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:54.036596 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.036570    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:54.171474 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.171357    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"]
May 20 21:57:54.173749 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:57:54.173725    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae64c27_76bc_4da6_9932_b45944cfa48d.slice/crio-dd93916414765d9a9f86e66b8c171c03d07c0a51aba1aca254899a754a03e352 WatchSource:0}: Error finding container dd93916414765d9a9f86e66b8c171c03d07c0a51aba1aca254899a754a03e352: Status 404 returned error can't find the container with id dd93916414765d9a9f86e66b8c171c03d07c0a51aba1aca254899a754a03e352
May 20 21:57:54.274619 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.274563    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"]
May 20 21:57:54.282640 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.282614    2523 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"]
May 20 21:57:54.327333 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.327290    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:57:54.331833 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.331815    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.349451 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.349377    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:57:54.460816 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.460787    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvcn\" (UniqueName: \"kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.460965 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.460846    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.562130 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.562081    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvcn\" (UniqueName: \"kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.562219 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.562137    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.562423 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.562406    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.574776 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.574756    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvcn\" (UniqueName: \"kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn\") pod \"kuadrant-operator-controller-manager-84b657d985-777gg\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.642330 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.642301    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:54.942622 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:54.942489    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:57:54.964172 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:57:54.964143    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode560f850_fd76_455b_88de_b5bd7721103b.slice/crio-b2674f064f0c45e884e9e6623d3b3f43077422df7586e1d123bdfe4c1851e8da WatchSource:0}: Error finding container b2674f064f0c45e884e9e6623d3b3f43077422df7586e1d123bdfe4c1851e8da: Status 404 returned error can't find the container with id b2674f064f0c45e884e9e6623d3b3f43077422df7586e1d123bdfe4c1851e8da
May 20 21:57:55.698350 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:55.698316    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" event={"ID":"e560f850-fd76-455b-88de-b5bd7721103b","Type":"ContainerStarted","Data":"b2674f064f0c45e884e9e6623d3b3f43077422df7586e1d123bdfe4c1851e8da"}
May 20 21:57:58.709598 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.709513    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" event={"ID":"e560f850-fd76-455b-88de-b5bd7721103b","Type":"ContainerStarted","Data":"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"}
May 20 21:57:58.709997 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.709591    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:57:58.711024 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.710997    2523 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" containerName="manager" containerID="cri-o://e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6" gracePeriod=2
May 20 21:57:58.734185 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.734138    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" podStartSLOduration=1.274208604 podStartE2EDuration="4.734123793s" podCreationTimestamp="2026-05-20 21:57:54 +0000 UTC" firstStartedPulling="2026-05-20 21:57:54.966296337 +0000 UTC m=+585.410563016" lastFinishedPulling="2026-05-20 21:57:58.426211527 +0000 UTC m=+588.870478205" observedRunningTime="2026-05-20 21:57:58.73263914 +0000 UTC m=+589.176905875" watchObservedRunningTime="2026-05-20 21:57:58.734123793 +0000 UTC m=+589.178390492"
May 20 21:57:58.937065 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.937044    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:58.939162 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:58.939139    2523 status_manager.go:895] "Failed to get status for pod" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws" err="pods \"kuadrant-operator-controller-manager-84b657d985-h4nws\" is forbidden: User \"system:node:ip-10-0-131-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-201.ec2.internal' and this object"
May 20 21:57:59.098120 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.098053    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume\") pod \"5ae64c27-76bc-4da6-9932-b45944cfa48d\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") "
May 20 21:57:59.098256 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.098121    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cntb\" (UniqueName: \"kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb\") pod \"5ae64c27-76bc-4da6-9932-b45944cfa48d\" (UID: \"5ae64c27-76bc-4da6-9932-b45944cfa48d\") "
May 20 21:57:59.098310 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.098262    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ae64c27-76bc-4da6-9932-b45944cfa48d" (UID: "5ae64c27-76bc-4da6-9932-b45944cfa48d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:57:59.098354 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.098321    2523 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae64c27-76bc-4da6-9932-b45944cfa48d-extensions-socket-volume\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:57:59.100275 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.100247    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb" (OuterVolumeSpecName: "kube-api-access-4cntb") pod "5ae64c27-76bc-4da6-9932-b45944cfa48d" (UID: "5ae64c27-76bc-4da6-9932-b45944cfa48d"). InnerVolumeSpecName "kube-api-access-4cntb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:57:59.198967 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.198919    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cntb\" (UniqueName: \"kubernetes.io/projected/5ae64c27-76bc-4da6-9932-b45944cfa48d-kube-api-access-4cntb\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:57:59.714812 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.714748    2523 generic.go:358] "Generic (PLEG): container finished" podID="5ae64c27-76bc-4da6-9932-b45944cfa48d" containerID="e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6" exitCode=2
May 20 21:57:59.714812 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.714798    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws"
May 20 21:57:59.715242 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.714846    2523 scope.go:117] "RemoveContainer" containerID="e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6"
May 20 21:57:59.717194 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.717169    2523 status_manager.go:895] "Failed to get status for pod" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws" err="pods \"kuadrant-operator-controller-manager-84b657d985-h4nws\" is forbidden: User \"system:node:ip-10-0-131-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-201.ec2.internal' and this object"
May 20 21:57:59.723085 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.723069    2523 scope.go:117] "RemoveContainer" containerID="e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6"
May 20 21:57:59.723322 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:57:59.723304    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6\": container with ID starting with e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6 not found: ID does not exist" containerID="e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6"
May 20 21:57:59.723366 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.723330    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6"} err="failed to get container status \"e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6\": rpc error: code = NotFound desc = could not find container \"e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6\": container with ID starting with e6affbf91b3d09c8d6b72055d32901a1b8f22966bd3c920d6e5bf11043bd1ae6 not found: ID does not exist"
May 20 21:57:59.724746 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:57:59.724730    2523 status_manager.go:895] "Failed to get status for pod" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws" err="pods \"kuadrant-operator-controller-manager-84b657d985-h4nws\" is forbidden: User \"system:node:ip-10-0-131-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-201.ec2.internal' and this object"
May 20 21:58:00.079149 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:00.079091    2523 status_manager.go:895] "Failed to get status for pod" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-h4nws" err="pods \"kuadrant-operator-controller-manager-84b657d985-h4nws\" is forbidden: User \"system:node:ip-10-0-131-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-201.ec2.internal' and this object"
May 20 21:58:00.080103 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:00.080079    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" path="/var/lib/kubelet/pods/5ae64c27-76bc-4da6-9932-b45944cfa48d/volumes"
May 20 21:58:09.717748 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:09.717716    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:58:10.010620 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:10.010599    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:58:10.010687 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:10.010667    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 21:58:21.790297 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:21.790264    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:58:21.793204 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:21.790510    2523 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" podUID="e560f850-fd76-455b-88de-b5bd7721103b" containerName="manager" containerID="cri-o://b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb" gracePeriod=10
May 20 21:58:22.025344 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.025319    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:58:22.155592 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.155563    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssvcn\" (UniqueName: \"kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn\") pod \"e560f850-fd76-455b-88de-b5bd7721103b\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") "
May 20 21:58:22.155726 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.155614    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume\") pod \"e560f850-fd76-455b-88de-b5bd7721103b\" (UID: \"e560f850-fd76-455b-88de-b5bd7721103b\") "
May 20 21:58:22.156030 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.156006    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e560f850-fd76-455b-88de-b5bd7721103b" (UID: "e560f850-fd76-455b-88de-b5bd7721103b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 20 21:58:22.157667 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.157648    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn" (OuterVolumeSpecName: "kube-api-access-ssvcn") pod "e560f850-fd76-455b-88de-b5bd7721103b" (UID: "e560f850-fd76-455b-88de-b5bd7721103b"). InnerVolumeSpecName "kube-api-access-ssvcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:58:22.257046 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.257024    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssvcn\" (UniqueName: \"kubernetes.io/projected/e560f850-fd76-455b-88de-b5bd7721103b-kube-api-access-ssvcn\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:58:22.257046 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.257045    2523 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e560f850-fd76-455b-88de-b5bd7721103b-extensions-socket-volume\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:58:22.782234 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.782205    2523 generic.go:358] "Generic (PLEG): container finished" podID="e560f850-fd76-455b-88de-b5bd7721103b" containerID="b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb" exitCode=0
May 20 21:58:22.782344 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.782243    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" event={"ID":"e560f850-fd76-455b-88de-b5bd7721103b","Type":"ContainerDied","Data":"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"}
May 20 21:58:22.782344 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.782263    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg" event={"ID":"e560f850-fd76-455b-88de-b5bd7721103b","Type":"ContainerDied","Data":"b2674f064f0c45e884e9e6623d3b3f43077422df7586e1d123bdfe4c1851e8da"}
May 20 21:58:22.782344 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.782276    2523 scope.go:117] "RemoveContainer" containerID="b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"
May 20 21:58:22.782344 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.782273    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"
May 20 21:58:22.790394 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.790375    2523 scope.go:117] "RemoveContainer" containerID="b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"
May 20 21:58:22.790651 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:58:22.790617    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb\": container with ID starting with b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb not found: ID does not exist" containerID="b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"
May 20 21:58:22.790651 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.790642    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb"} err="failed to get container status \"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb\": rpc error: code = NotFound desc = could not find container \"b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb\": container with ID starting with b5078a48b798162788a06f4e78b82f520a523e1584473262f202cee8a73004bb not found: ID does not exist"
May 20 21:58:22.811760 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.811740    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:58:22.817671 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:22.817647    2523 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-777gg"]
May 20 21:58:24.076053 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:24.076022    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e560f850-fd76-455b-88de-b5bd7721103b" path="/var/lib/kubelet/pods/e560f850-fd76-455b-88de-b5bd7721103b/volumes"
May 20 21:58:43.907752 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.907712    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908027    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e560f850-fd76-455b-88de-b5bd7721103b" containerName="manager"
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908039    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="e560f850-fd76-455b-88de-b5bd7721103b" containerName="manager"
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908052    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" containerName="manager"
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908057    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" containerName="manager"
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908114    2523 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ae64c27-76bc-4da6-9932-b45944cfa48d" containerName="manager"
May 20 21:58:43.908167 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.908123    2523 memory_manager.go:356] "RemoveStaleState removing state" podUID="e560f850-fd76-455b-88de-b5bd7721103b" containerName="manager"
May 20 21:58:43.910743 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.910728    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:43.916851 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.916650    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 20 21:58:43.917031 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.917012    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97wlc\""
May 20 21:58:43.937105 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:43.937080    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:44.009959 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.009907    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnjsp\" (UniqueName: \"kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.010085 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.009986    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.019018 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.018989    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:44.111262 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.111231    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnjsp\" (UniqueName: \"kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.111515 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.111482    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.112121 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.112091    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.119585 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.119563    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnjsp\" (UniqueName: \"kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp\") pod \"limitador-limitador-7d549b5b-2mpnc\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.220734 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.220675    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:44.357420 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.357396    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:44.360030 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:58:44.359999    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235699a7_8c30_4e1b_aa7b_27c77d5e0d4d.slice/crio-f11249d9e3548f1e1d2fd80897e35c14777edcb28698102c4107d1634f492b62 WatchSource:0}: Error finding container f11249d9e3548f1e1d2fd80897e35c14777edcb28698102c4107d1634f492b62: Status 404 returned error can't find the container with id f11249d9e3548f1e1d2fd80897e35c14777edcb28698102c4107d1634f492b62
May 20 21:58:44.361675 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.361658    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 21:58:44.847465 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:44.847436    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" event={"ID":"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d","Type":"ContainerStarted","Data":"f11249d9e3548f1e1d2fd80897e35c14777edcb28698102c4107d1634f492b62"}
May 20 21:58:47.859614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:47.859586    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" event={"ID":"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d","Type":"ContainerStarted","Data":"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"}
May 20 21:58:47.859964 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:47.859638    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:47.875705 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:47.875661    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" podStartSLOduration=2.36620821 podStartE2EDuration="4.875647309s" podCreationTimestamp="2026-05-20 21:58:43 +0000 UTC" firstStartedPulling="2026-05-20 21:58:44.361777529 +0000 UTC m=+634.806044208" lastFinishedPulling="2026-05-20 21:58:46.871216625 +0000 UTC m=+637.315483307" observedRunningTime="2026-05-20 21:58:47.874917116 +0000 UTC m=+638.319183814" watchObservedRunningTime="2026-05-20 21:58:47.875647309 +0000 UTC m=+638.319914049"
May 20 21:58:58.863436 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:58.863411    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:58.872828 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:58.872799    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:58.893497 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:58.893446    2523 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" podUID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" containerName="limitador" containerID="cri-o://5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606" gracePeriod=30
May 20 21:58:59.427200 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.427177    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:59.517915 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.517863    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnjsp\" (UniqueName: \"kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp\") pod \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") "
May 20 21:58:59.518044 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.517951    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file\") pod \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\" (UID: \"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d\") "
May 20 21:58:59.518301 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.518277    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file" (OuterVolumeSpecName: "config-file") pod "235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" (UID: "235699a7-8c30-4e1b-aa7b-27c77d5e0d4d"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 20 21:58:59.519928 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.519910    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp" (OuterVolumeSpecName: "kube-api-access-rnjsp") pod "235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" (UID: "235699a7-8c30-4e1b-aa7b-27c77d5e0d4d"). InnerVolumeSpecName "kube-api-access-rnjsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 21:58:59.619340 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.619317    2523 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-config-file\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:58:59.619340 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.619338    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnjsp\" (UniqueName: \"kubernetes.io/projected/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d-kube-api-access-rnjsp\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 21:58:59.897541 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.897518    2523 generic.go:358] "Generic (PLEG): container finished" podID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" containerID="5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606" exitCode=0
May 20 21:58:59.897820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.897575    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc"
May 20 21:58:59.897820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.897608    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" event={"ID":"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d","Type":"ContainerDied","Data":"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"}
May 20 21:58:59.897820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.897643    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2mpnc" event={"ID":"235699a7-8c30-4e1b-aa7b-27c77d5e0d4d","Type":"ContainerDied","Data":"f11249d9e3548f1e1d2fd80897e35c14777edcb28698102c4107d1634f492b62"}
May 20 21:58:59.897820 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.897658    2523 scope.go:117] "RemoveContainer" containerID="5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"
May 20 21:58:59.906171 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.906155    2523 scope.go:117] "RemoveContainer" containerID="5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"
May 20 21:58:59.906385 ip-10-0-131-201 kubenswrapper[2523]: E0520 21:58:59.906369    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606\": container with ID starting with 5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606 not found: ID does not exist" containerID="5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"
May 20 21:58:59.906431 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.906393    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606"} err="failed to get container status \"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606\": rpc error: code = NotFound desc = could not find container \"5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606\": container with ID starting with 5d43a5a1bd5ef652d50c491866f6e54d0c46b948c0ed6f7eb72e71f24d2bf606 not found: ID does not exist"
May 20 21:58:59.917395 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.917370    2523 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:58:59.920614 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:58:59.920594    2523 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2mpnc"]
May 20 21:59:00.075922 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:00.075893    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" path="/var/lib/kubelet/pods/235699a7-8c30-4e1b-aa7b-27c77d5e0d4d/volumes"
May 20 21:59:01.459806 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.459780    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-89nk6"]
May 20 21:59:01.460200 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.460068    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" containerName="limitador"
May 20 21:59:01.460200 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.460080    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" containerName="limitador"
May 20 21:59:01.460200 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.460137    2523 memory_manager.go:356] "RemoveStaleState removing state" podUID="235699a7-8c30-4e1b-aa7b-27c77d5e0d4d" containerName="limitador"
May 20 21:59:01.464135 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.464115    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.466312 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.466291    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wqjhb\""
May 20 21:59:01.466411 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.466291    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 20 21:59:01.470209 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.470188    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-89nk6"]
May 20 21:59:01.532683 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.532655    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/170fbb64-08d1-4ff3-906c-43157c89da21-data\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.532784 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.532697    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhhh\" (UniqueName: \"kubernetes.io/projected/170fbb64-08d1-4ff3-906c-43157c89da21-kube-api-access-9qhhh\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.633059 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.633033    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/170fbb64-08d1-4ff3-906c-43157c89da21-data\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.633151 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.633066    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhhh\" (UniqueName: \"kubernetes.io/projected/170fbb64-08d1-4ff3-906c-43157c89da21-kube-api-access-9qhhh\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.633361 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.633345    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/170fbb64-08d1-4ff3-906c-43157c89da21-data\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.648546 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.648522    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhhh\" (UniqueName: \"kubernetes.io/projected/170fbb64-08d1-4ff3-906c-43157c89da21-kube-api-access-9qhhh\") pod \"postgres-68c4fbbd6f-89nk6\" (UID: \"170fbb64-08d1-4ff3-906c-43157c89da21\") " pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.775673 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.775625    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:01.899812 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:01.899786    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-89nk6"]
May 20 21:59:01.902301 ip-10-0-131-201 kubenswrapper[2523]: W0520 21:59:01.902243    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170fbb64_08d1_4ff3_906c_43157c89da21.slice/crio-13f6a0b7ab509e5e02678578141c651760b92a94f6409d40636862368f070d91 WatchSource:0}: Error finding container 13f6a0b7ab509e5e02678578141c651760b92a94f6409d40636862368f070d91: Status 404 returned error can't find the container with id 13f6a0b7ab509e5e02678578141c651760b92a94f6409d40636862368f070d91
May 20 21:59:02.909295 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:02.909263    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-89nk6" event={"ID":"170fbb64-08d1-4ff3-906c-43157c89da21","Type":"ContainerStarted","Data":"13f6a0b7ab509e5e02678578141c651760b92a94f6409d40636862368f070d91"}
May 20 21:59:08.931283 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:08.931250    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-89nk6" event={"ID":"170fbb64-08d1-4ff3-906c-43157c89da21","Type":"ContainerStarted","Data":"2e943f0c8b3c30c29aaf4da9adba121431ca27c4dc88b45f042ac9c01b66be74"}
May 20 21:59:08.931696 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:08.931297    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:08.948831 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:08.948780    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-89nk6" podStartSLOduration=1.876041252 podStartE2EDuration="7.94876752s" podCreationTimestamp="2026-05-20 21:59:01 +0000 UTC" firstStartedPulling="2026-05-20 21:59:01.904037722 +0000 UTC m=+652.348304400" lastFinishedPulling="2026-05-20 21:59:07.976763989 +0000 UTC m=+658.421030668" observedRunningTime="2026-05-20 21:59:08.94715608 +0000 UTC m=+659.391422785" watchObservedRunningTime="2026-05-20 21:59:08.94876752 +0000 UTC m=+659.393034219"
May 20 21:59:14.961974 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:14.961927    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-89nk6"
May 20 21:59:24.286667 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.286631    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-rsl4l"]
May 20 21:59:24.313523 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.313501    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-rsl4l"]
May 20 21:59:24.313682 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.313624    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l"
May 20 21:59:24.316192 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.316165    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 20 21:59:24.316386 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.316366    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-x7xp4\""
May 20 21:59:24.316494 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.316370    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 20 21:59:24.496906 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.496881    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xm56\" (UniqueName: \"kubernetes.io/projected/7998abe6-aa4c-44e1-94e0-8f832691d60f-kube-api-access-8xm56\") pod \"keycloak-operator-7864d68cbd-rsl4l\" (UID: \"7998abe6-aa4c-44e1-94e0-8f832691d60f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l"
May 20 21:59:24.597161 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.597112    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xm56\" (UniqueName: \"kubernetes.io/projected/7998abe6-aa4c-44e1-94e0-8f832691d60f-kube-api-access-8xm56\") pod \"keycloak-operator-7864d68cbd-rsl4l\" (UID: \"7998abe6-aa4c-44e1-94e0-8f832691d60f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l"
May 20 21:59:24.605289 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.605269    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xm56\" (UniqueName: \"kubernetes.io/projected/7998abe6-aa4c-44e1-94e0-8f832691d60f-kube-api-access-8xm56\") pod \"keycloak-operator-7864d68cbd-rsl4l\" (UID: \"7998abe6-aa4c-44e1-94e0-8f832691d60f\") " pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l"
May 20 21:59:24.623711 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.623688    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l"
May 20 21:59:24.747682 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.746499    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-rsl4l"]
May 20 21:59:24.977465 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:24.977437    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l" event={"ID":"7998abe6-aa4c-44e1-94e0-8f832691d60f","Type":"ContainerStarted","Data":"2f49e09bd3ff7b1c0cfbab87fdba3dba4581aaac0d3583b3c587dfb549d1813c"}
May 20 21:59:31.003018 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:31.002980    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l" event={"ID":"7998abe6-aa4c-44e1-94e0-8f832691d60f","Type":"ContainerStarted","Data":"2648da2e97d755b9723d334fc5731b83a11ea15c0898350c7636713ebeb1f37b"}
May 20 21:59:31.020183 ip-10-0-131-201 kubenswrapper[2523]: I0520 21:59:31.020141    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-rsl4l" podStartSLOduration=1.702799074 podStartE2EDuration="7.020129254s" podCreationTimestamp="2026-05-20 21:59:24 +0000 UTC" firstStartedPulling="2026-05-20 21:59:24.75198354 +0000 UTC m=+675.196250220" lastFinishedPulling="2026-05-20 21:59:30.069313707 +0000 UTC m=+680.513580400" observedRunningTime="2026-05-20 21:59:31.018712664 +0000 UTC m=+681.462979363" watchObservedRunningTime="2026-05-20 21:59:31.020129254 +0000 UTC m=+681.464395955"
May 20 22:03:10.033064 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:10.032993    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:03:10.034772 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:10.034748    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:03:27.794468 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.794441    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"]
May 20 22:03:27.796570 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.796551    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.800327 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.800304    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 20 22:03:27.800450 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.800415    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 20 22:03:27.800528 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.800448    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 20 22:03:27.800580 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.800531    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h2g5p\""
May 20 22:03:27.809303 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.809281    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"]
May 20 22:03:27.933188 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933164    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.933302 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933198    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.933302 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933221    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.933302 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933246    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.933302 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933275    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:27.933423 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:27.933313    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbkj\" (UniqueName: \"kubernetes.io/projected/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kube-api-access-mgbkj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034149 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034123    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbkj\" (UniqueName: \"kubernetes.io/projected/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kube-api-access-mgbkj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034257 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034159    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034257 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034185    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034257 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034206    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034257 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034221    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034257 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034242    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034559 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034539    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034594 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034570    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.034626 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.034590    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.036594 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.036574    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.036808 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.036788    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.042251 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.042228    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbkj\" (UniqueName: \"kubernetes.io/projected/ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de-kube-api-access-mgbkj\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r\" (UID: \"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.106204 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.106142    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:28.253519 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.253491    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"]
May 20 22:03:28.691422 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:28.691394    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r" event={"ID":"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de","Type":"ContainerStarted","Data":"a40148aef9adef68b0a262c2633bcad8cfced287a751db4580a91058fb981bc7"}
May 20 22:03:34.718023 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:34.717988    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r" event={"ID":"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de","Type":"ContainerStarted","Data":"b5ce09b54388d2a313f3bc7438f460d17b6670d3f13d49a393787714d487bf52"}
May 20 22:03:39.734064 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:39.734027    2523 generic.go:358] "Generic (PLEG): container finished" podID="ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de" containerID="b5ce09b54388d2a313f3bc7438f460d17b6670d3f13d49a393787714d487bf52" exitCode=0
May 20 22:03:39.734417 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:39.734070    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r" event={"ID":"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de","Type":"ContainerDied","Data":"b5ce09b54388d2a313f3bc7438f460d17b6670d3f13d49a393787714d487bf52"}
May 20 22:03:41.743230 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:41.743199    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r" event={"ID":"ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de","Type":"ContainerStarted","Data":"8bae707aee9b2c0c7dd14d42e307e824ff431542db72ee95e6b164db35846c91"}
May 20 22:03:41.743558 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:41.743407    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:03:41.762733 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:41.762677    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r" podStartSLOduration=1.986314815 podStartE2EDuration="14.762659822s" podCreationTimestamp="2026-05-20 22:03:27 +0000 UTC" firstStartedPulling="2026-05-20 22:03:28.257841249 +0000 UTC m=+918.702107927" lastFinishedPulling="2026-05-20 22:03:41.034186241 +0000 UTC m=+931.478452934" observedRunningTime="2026-05-20 22:03:41.761706814 +0000 UTC m=+932.205973513" watchObservedRunningTime="2026-05-20 22:03:41.762659822 +0000 UTC m=+932.206926521"
May 20 22:03:52.757974 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:03:52.757918    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r"
May 20 22:08:10.052972 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:08:10.052927    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:08:10.055354 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:08:10.055332    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:13:10.073166 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:13:10.073136    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:13:10.076975 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:13:10.076953    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:15:00.160850 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.160780    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29655255-ddkkc"]
May 20 22:15:00.164116 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.164101    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:00.166638 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.166616    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-l6b9v\""
May 20 22:15:00.172100 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.172078    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655255-ddkkc"]
May 20 22:15:00.213890 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.213864    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bmn\" (UniqueName: \"kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn\") pod \"maas-api-key-cleanup-29655255-ddkkc\" (UID: \"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8\") " pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:00.314926 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.314902    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85bmn\" (UniqueName: \"kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn\") pod \"maas-api-key-cleanup-29655255-ddkkc\" (UID: \"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8\") " pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:00.323958 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.323917    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bmn\" (UniqueName: \"kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn\") pod \"maas-api-key-cleanup-29655255-ddkkc\" (UID: \"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8\") " pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:00.474883 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.474836    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:00.595910 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.595871    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29655255-ddkkc"]
May 20 22:15:00.598418 ip-10-0-131-201 kubenswrapper[2523]: W0520 22:15:00.598392    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f2ef1b_b31c_484b_abf0_ce77bbc1cbc8.slice/crio-5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442 WatchSource:0}: Error finding container 5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442: Status 404 returned error can't find the container with id 5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442
May 20 22:15:00.600161 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.600142    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 22:15:00.760897 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:00.760841    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc" event={"ID":"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8","Type":"ContainerStarted","Data":"5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442"}
May 20 22:15:03.772147 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:03.772117    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc" event={"ID":"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8","Type":"ContainerStarted","Data":"8cf22c1efa75d4bba6b69786ee1df43ddfcb8c25739c10415f75f321b40a9c36"}
May 20 22:15:03.788344 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:03.788299    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc" podStartSLOduration=1.217898613 podStartE2EDuration="3.788282943s" podCreationTimestamp="2026-05-20 22:15:00 +0000 UTC" firstStartedPulling="2026-05-20 22:15:00.60027594 +0000 UTC m=+1611.044542619" lastFinishedPulling="2026-05-20 22:15:03.170660252 +0000 UTC m=+1613.614926949" observedRunningTime="2026-05-20 22:15:03.787111854 +0000 UTC m=+1614.231378553" watchObservedRunningTime="2026-05-20 22:15:03.788282943 +0000 UTC m=+1614.232549645"
May 20 22:15:04.776598 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:04.776565    2523 generic.go:358] "Generic (PLEG): container finished" podID="75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8" containerID="8cf22c1efa75d4bba6b69786ee1df43ddfcb8c25739c10415f75f321b40a9c36" exitCode=0
May 20 22:15:04.776971 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:04.776652    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc" event={"ID":"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8","Type":"ContainerDied","Data":"8cf22c1efa75d4bba6b69786ee1df43ddfcb8c25739c10415f75f321b40a9c36"}
May 20 22:15:05.902588 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:05.902568    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:05.959773 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:05.959748    2523 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85bmn\" (UniqueName: \"kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn\") pod \"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8\" (UID: \"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8\") "
May 20 22:15:05.961899 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:05.961881    2523 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn" (OuterVolumeSpecName: "kube-api-access-85bmn") pod "75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8" (UID: "75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8"). InnerVolumeSpecName "kube-api-access-85bmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 20 22:15:06.060798 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:06.060747    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85bmn\" (UniqueName: \"kubernetes.io/projected/75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8-kube-api-access-85bmn\") on node \"ip-10-0-131-201.ec2.internal\" DevicePath \"\""
May 20 22:15:06.783407 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:06.783383    2523 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc"
May 20 22:15:06.783407 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:06.783388    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29655255-ddkkc" event={"ID":"75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8","Type":"ContainerDied","Data":"5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442"}
May 20 22:15:06.783584 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:06.783413    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5725a2dfd5d5da321ddd01a3986eb70b4880d531360eb306e3b8981ade657442"
May 20 22:15:56.162604 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.162570    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"]
May 20 22:15:56.163068 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.162861    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8" containerName="cleanup"
May 20 22:15:56.163068 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.162870    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8" containerName="cleanup"
May 20 22:15:56.163068 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.162923    2523 memory_manager.go:356] "RemoveStaleState removing state" podUID="75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8" containerName="cleanup"
May 20 22:15:56.165600 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.165584    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.168075 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.168051    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-j65r2\""
May 20 22:15:56.178142 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.178118    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"]
May 20 22:15:56.293950 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.293909    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d35a0bb-9816-49ea-9875-f0691c29c6b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.294059 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.293974    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr7hz\" (UniqueName: \"kubernetes.io/projected/5d35a0bb-9816-49ea-9875-f0691c29c6b4-kube-api-access-gr7hz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.394234 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.394207    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d35a0bb-9816-49ea-9875-f0691c29c6b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.394338 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.394257    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr7hz\" (UniqueName: \"kubernetes.io/projected/5d35a0bb-9816-49ea-9875-f0691c29c6b4-kube-api-access-gr7hz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.394541 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.394523    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d35a0bb-9816-49ea-9875-f0691c29c6b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.403132 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.403102    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr7hz\" (UniqueName: \"kubernetes.io/projected/5d35a0bb-9816-49ea-9875-f0691c29c6b4-kube-api-access-gr7hz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-m9mwf\" (UID: \"5d35a0bb-9816-49ea-9875-f0691c29c6b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.475629 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.475581    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.630221 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.630197    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"]
May 20 22:15:56.632262 ip-10-0-131-201 kubenswrapper[2523]: W0520 22:15:56.632235    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d35a0bb_9816_49ea_9875_f0691c29c6b4.slice/crio-05e37d6691eb7dff5740e81d2e2de04164f95b1a114bbdeb78f27fee24d01b39 WatchSource:0}: Error finding container 05e37d6691eb7dff5740e81d2e2de04164f95b1a114bbdeb78f27fee24d01b39: Status 404 returned error can't find the container with id 05e37d6691eb7dff5740e81d2e2de04164f95b1a114bbdeb78f27fee24d01b39
May 20 22:15:56.940439 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.940403    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf" event={"ID":"5d35a0bb-9816-49ea-9875-f0691c29c6b4","Type":"ContainerStarted","Data":"352a96119bdd1b30ba685b9b6b736084a9782ca0730d4a361c13dd243856d62b"}
May 20 22:15:56.940439 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.940436    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf" event={"ID":"5d35a0bb-9816-49ea-9875-f0691c29c6b4","Type":"ContainerStarted","Data":"05e37d6691eb7dff5740e81d2e2de04164f95b1a114bbdeb78f27fee24d01b39"}
May 20 22:15:56.940607 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.940524    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:15:56.968805 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:15:56.968762    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf" podStartSLOduration=0.968747507 podStartE2EDuration="968.747507ms" podCreationTimestamp="2026-05-20 22:15:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 22:15:56.966604226 +0000 UTC m=+1667.410870939" watchObservedRunningTime="2026-05-20 22:15:56.968747507 +0000 UTC m=+1667.413014206"
May 20 22:16:07.946656 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:16:07.946630    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-m9mwf"
May 20 22:18:10.097521 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:18:10.097496    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:18:10.100282 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:18:10.100257    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:23:10.126578 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:23:10.126552    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:23:10.130853 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:23:10.130832    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsx9x_69f19b4e-ad32-4085-8f69-7e5974cda1e0/ovn-acl-logging/0.log"
May 20 22:25:43.254578 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:43.254544    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lmsfq_75e4463d-55a9-45ad-9a4a-37513f2abc00/manager/0.log"
May 20 22:25:43.490907 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:43.490882    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655255-ddkkc_75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8/cleanup/0.log"
May 20 22:25:43.742450 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:43.742402    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-dnnk6_f5f38955-763e-4e58-9764-630fc9a7646f/manager/2.log"
May 20 22:25:44.072775 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:44.072713    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-zpfxx_e3ecb258-f46d-4467-ae6f-e67a72a29658/manager/0.log"
May 20 22:25:44.184318 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:44.184298    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-89nk6_170fbb64-08d1-4ff3-906c-43157c89da21/postgres/0.log"
May 20 22:25:45.507622 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:45.507596    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-hf8hh_9a83132f-5bf3-4fe6-b975-cafcc809dac8/manager/0.log"
May 20 22:25:45.614167 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:45.614132    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-gq78p_4a341d70-b8e3-4976-803f-77d31e0717c0/manager/0.log"
May 20 22:25:45.949188 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:45.949163    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m9mwf_5d35a0bb-9816-49ea-9875-f0691c29c6b4/manager/0.log"
May 20 22:25:46.610966 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:46.610914    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-7bljs_88dfcb76-2b69-43bd-90f9-df83825148a5/discovery/0.log"
May 20 22:25:46.826719 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:46.826694    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6544789b6f-nwcsp_9f811347-6eaf-4cbe-976a-686e26d4c99c/kube-auth-proxy/0.log"
May 20 22:25:47.509531 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:47.509495    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r_ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de/main/0.log"
May 20 22:25:47.515770 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:47.515722    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-zn87r_ac35a9c6-5cad-4ec0-8ce6-4ca39073d6de/storage-initializer/0.log"
May 20 22:25:54.878944 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:54.878895    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dm6qf_7be092c0-dc6d-422a-bc0f-0e32d65106e0/global-pull-secret-syncer/0.log"
May 20 22:25:55.028351 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:55.028327    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rfdl8_2785f6b2-6fd6-41a5-afd0-388cf8cfacdc/konnectivity-agent/0.log"
May 20 22:25:55.079927 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:55.079899    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-201.ec2.internal_d60309927476571f99020f085b436480/haproxy/0.log"
May 20 22:25:59.678270 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:59.678229    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-hf8hh_9a83132f-5bf3-4fe6-b975-cafcc809dac8/manager/0.log"
May 20 22:25:59.704213 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:59.704159    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-gq78p_4a341d70-b8e3-4976-803f-77d31e0717c0/manager/0.log"
May 20 22:25:59.845894 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:25:59.845872    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-m9mwf_5d35a0bb-9816-49ea-9875-f0691c29c6b4/manager/0.log"
May 20 22:26:02.101099 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:02.101073    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/node-exporter/0.log"
May 20 22:26:02.124417 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:02.124397    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/kube-rbac-proxy/0.log"
May 20 22:26:02.146404 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:02.146386    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9gq5_d60f18db-791e-429d-a2f0-0c1cee4ab0fd/init-textfile/0.log"
May 20 22:26:03.238732 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.238703    2523 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"]
May 20 22:26:03.242036 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.242019    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.244884 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.244862    2523 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2wgpr\"/\"default-dockercfg-hdmrk\""
May 20 22:26:03.245229 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.245213    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"kube-root-ca.crt\""
May 20 22:26:03.245818 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.245802    2523 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2wgpr\"/\"openshift-service-ca.crt\""
May 20 22:26:03.254372 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.254341    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"]
May 20 22:26:03.350542 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.350515    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-proc\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.350674 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.350562    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-lib-modules\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.350674 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.350647    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-sys\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.350785 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.350732    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j64td\" (UniqueName: \"kubernetes.io/projected/1e795eab-4c28-4e09-8e64-c75fd91ec407-kube-api-access-j64td\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.350785 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.350765    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-podres\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451435 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451415    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-podres\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451556 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451450    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-proc\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451556 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451470    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-lib-modules\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451556 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451529    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-proc\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451556 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451554    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-sys\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451716 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451595    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-podres\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451716 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451654    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-lib-modules\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451716 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451663    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e795eab-4c28-4e09-8e64-c75fd91ec407-sys\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.451716 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.451673    2523 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j64td\" (UniqueName: \"kubernetes.io/projected/1e795eab-4c28-4e09-8e64-c75fd91ec407-kube-api-access-j64td\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.462225 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.462206    2523 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j64td\" (UniqueName: \"kubernetes.io/projected/1e795eab-4c28-4e09-8e64-c75fd91ec407-kube-api-access-j64td\") pod \"perf-node-gather-daemonset-qcbhw\" (UID: \"1e795eab-4c28-4e09-8e64-c75fd91ec407\") " pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.552080 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.552023    2523 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.683850 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.683808    2523 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"]
May 20 22:26:03.686997 ip-10-0-131-201 kubenswrapper[2523]: W0520 22:26:03.686967    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1e795eab_4c28_4e09_8e64_c75fd91ec407.slice/crio-8377ff645690e3276d0f5f4740ca2fefaa72edd457d241a0c2d90125686ebe4e WatchSource:0}: Error finding container 8377ff645690e3276d0f5f4740ca2fefaa72edd457d241a0c2d90125686ebe4e: Status 404 returned error can't find the container with id 8377ff645690e3276d0f5f4740ca2fefaa72edd457d241a0c2d90125686ebe4e
May 20 22:26:03.688607 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.688589    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 20 22:26:03.859313 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.859292    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-g7v4d_b8a217db-5731-499f-96c4-f41fb227fe7a/networking-console-plugin/0.log"
May 20 22:26:03.861221 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.861193    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw" event={"ID":"1e795eab-4c28-4e09-8e64-c75fd91ec407","Type":"ContainerStarted","Data":"57e08cf982db9cd6e9a3ae7e28392271789960c3939ff40c3d7eeca799a0406e"}
May 20 22:26:03.861311 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.861226    2523 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw" event={"ID":"1e795eab-4c28-4e09-8e64-c75fd91ec407","Type":"ContainerStarted","Data":"8377ff645690e3276d0f5f4740ca2fefaa72edd457d241a0c2d90125686ebe4e"}
May 20 22:26:03.861349 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.861310    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:03.886728 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:03.886690    2523 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw" podStartSLOduration=0.88667604 podStartE2EDuration="886.67604ms" podCreationTimestamp="2026-05-20 22:26:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-20 22:26:03.885178575 +0000 UTC m=+2274.329445279" watchObservedRunningTime="2026-05-20 22:26:03.88667604 +0000 UTC m=+2274.330942739"
May 20 22:26:06.318527 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:06.318499    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wxr9_b915e3b0-1702-4393-b027-adb3412143b9/dns/0.log"
May 20 22:26:06.354345 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:06.354320    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6wxr9_b915e3b0-1702-4393-b027-adb3412143b9/kube-rbac-proxy/0.log"
May 20 22:26:06.558812 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:06.558784    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvlst_35268b42-1b17-424e-b1c9-c9cab65aa1bb/dns-node-resolver/0.log"
May 20 22:26:07.305798 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:07.305766    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htjt7_d31fdb6e-6620-40cd-b00b-d66aeeb33eb3/node-ca/0.log"
May 20 22:26:08.528530 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:08.528482    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-7bljs_88dfcb76-2b69-43bd-90f9-df83825148a5/discovery/0.log"
May 20 22:26:08.579447 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:08.579423    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6544789b6f-nwcsp_9f811347-6eaf-4cbe-976a-686e26d4c99c/kube-auth-proxy/0.log"
May 20 22:26:09.374386 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:09.374361    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fnpss_f3c43b80-d572-4582-bf3b-6f346ac0ca09/serve-healthcheck-canary/0.log"
May 20 22:26:09.874633 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:09.874611    2523 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2wgpr/perf-node-gather-daemonset-qcbhw"
May 20 22:26:09.886505 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:09.886484    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rwgv_e995459b-44da-49c4-8542-77d4c92c9454/kube-rbac-proxy/0.log"
May 20 22:26:09.919012 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:09.918988    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rwgv_e995459b-44da-49c4-8542-77d4c92c9454/exporter/0.log"
May 20 22:26:09.950770 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:09.950751    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7rwgv_e995459b-44da-49c4-8542-77d4c92c9454/extractor/0.log"
May 20 22:26:12.115897 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.115862    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-lmsfq_75e4463d-55a9-45ad-9a4a-37513f2abc00/manager/0.log"
May 20 22:26:12.187758 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.187736    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29655255-ddkkc_75f2ef1b-b31c-484b-abf0-ce77bbc1cbc8/cleanup/0.log"
May 20 22:26:12.335620 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.335597    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-dnnk6_f5f38955-763e-4e58-9764-630fc9a7646f/manager/1.log"
May 20 22:26:12.344590 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.344571    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-dnnk6_f5f38955-763e-4e58-9764-630fc9a7646f/manager/2.log"
May 20 22:26:12.459054 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.458998    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c897df989-zpfxx_e3ecb258-f46d-4467-ae6f-e67a72a29658/manager/0.log"
May 20 22:26:12.479975 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:12.479954    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-89nk6_170fbb64-08d1-4ff3-906c-43157c89da21/postgres/0.log"
May 20 22:26:14.101305 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:14.101234    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-sg69p_cd2d6627-5406-44b1-8d82-e5a3b0807c37/openshift-lws-operator/0.log"
May 20 22:26:20.332828 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.332803    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/kube-multus-additional-cni-plugins/0.log"
May 20 22:26:20.360588 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.360560    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/egress-router-binary-copy/0.log"
May 20 22:26:20.382920 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.382898    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/cni-plugins/0.log"
May 20 22:26:20.404741 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.404720    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/bond-cni-plugin/0.log"
May 20 22:26:20.427528 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.427509    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/routeoverride-cni/0.log"
May 20 22:26:20.452607 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.452587    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/whereabouts-cni-bincopy/0.log"
May 20 22:26:20.477763 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:20.477743    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-47gqf_8bc77ccf-531c-4efa-a911-79792f21fdd5/whereabouts-cni/0.log"
May 20 22:26:21.120208 ip-10-0-131-201 kubenswrapper[2523]: I0520 22:26:21.120185    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t9rrx_dc4d3a0d-d1f1-4fbd-8f54-9e58714a9ef0/kube-multus/0.log"