Sep 16 21:46:51.914071 ip-10-0-129-128 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 21:46:51.914083 ip-10-0-129-128 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 21:46:51.914093 ip-10-0-129-128 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 21:46:51.914506 ip-10-0-129-128 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 21:47:01.936909 ip-10-0-129-128 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 21:47:01.936926 ip-10-0-129-128 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8fbdd59873e04db2a85768cab60dd8e4 --
Sep 16 21:48:40.214914 ip-10-0-129-128 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 21:48:40.608971 ip-10-0-129-128 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:48:40.608971 ip-10-0-129-128 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 21:48:40.608971 ip-10-0-129-128 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:48:40.608971 ip-10-0-129-128 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 21:48:40.608971 ip-10-0-129-128 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 21:48:40.611686 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.611582    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 21:48:40.616384 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616367    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.616384 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616384    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616389    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616392    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616395    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616397    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616400    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616404    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616406    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616409    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616411    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616414    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616417    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616419    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616422    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616424    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616427    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616430    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616432    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616435    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616438    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.616456 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616441    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616443    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616446    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616449    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616451    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616454    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616456    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616459    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616462    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616474    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616477    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616479    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616482    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616484    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616487    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616489    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616492    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616494    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616497    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616499    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.616938 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616501    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616504    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616506    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616509    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616511    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616514    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616518    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616522    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616524    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616527    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616529    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616532    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616534    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616537    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616541    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616545    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616547    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616550    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616553    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.617442 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616555    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616557    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616560    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616563    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616565    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616568    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616571    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616574    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616576    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616578    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616581    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616585    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616588    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616591    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616594    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616596    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616598    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616601    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616604    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616619    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.618008 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616623    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616626    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616628    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616631    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616634    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616636    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616638    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616642    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616645    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616648    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616651    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616655    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616659    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616662    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616665    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616668    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616671    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616674    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.616677    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.618487 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617371    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617377    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617380    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617383    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617385    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617388    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617391    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617394    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617396    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617399    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617401    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617404    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617409    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617413    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617415    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617418    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617421    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617424    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617427    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.618964 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617429    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617432    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617434    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617437    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617440    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617442    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617445    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617448    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617451    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617454    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617456    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617459    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617462    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617465    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617468    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617470    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617473    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617476    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617478    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617481    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.619439 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617483    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617486    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617488    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617491    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617493    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617495    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617498    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617500    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617503    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617506    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617509    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617513    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617517    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617520    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617523    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617526    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617529    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617532    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617534    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.619981 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617537    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617540    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617543    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617546    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617549    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617555    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617557    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617560    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617562    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617565    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617568    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617570    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617573    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617575    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617578    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617581    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617583    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617585    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617588    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617590    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.620441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617593    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617595    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617598    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617600    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617603    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617620    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617623    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617626    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617629    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617632    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617634    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617637    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617640    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617642    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617645    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617647    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617650    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617652    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617655    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.620942 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617658    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.617662    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618036    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618041    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618044    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618047    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618050    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618055    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618058    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618060    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618063    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618065    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618068    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618071    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618074    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618076    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618079    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618081    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618084    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.621392 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618088    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618092    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618094    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618097    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618100    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618102    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618105    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618107    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618110    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618112    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618114    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618117    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618120    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618122    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618125    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618127    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618130    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618132    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618134    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618137    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.621873 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618141    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618144    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618146    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618148    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618151    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618154    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618158    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618160    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618163    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618166    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618169    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618171    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618173    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618176    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618179    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618181    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618184    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618186    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618188    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.622359 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618191    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618194    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618196    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618199    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618201    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618203    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618207    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618209    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618212    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618214    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618216    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618219    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618221    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618225    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618228    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618231    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618233    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618236    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618238    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618241    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.622863 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618243    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618246    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618248    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618251    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618253    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618256    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618259    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618262    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618264    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618267    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618269    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618271    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618274    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618277    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618279    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618283    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618286    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618289    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618291    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.623346 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618294    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618297    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618299    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.618302    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618378    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618414    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618420    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618424    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618428    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618432    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618436    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618441    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618444    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618447    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618450    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618454    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618457    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618460    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618462    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618465    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618468    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618472    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618476    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618479    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 21:48:40.623812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618482    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618485    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618488    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618492    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618496    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618499    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618502    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618505    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618508    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618511    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618514    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618517    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618521    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618524    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618527    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618530    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618533    2580 flags.go:64] FLAG: --enable-server="true"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618536    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618540    2580 flags.go:64] FLAG: --event-burst="100"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618542    2580 flags.go:64] FLAG: --event-qps="50"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618545    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618548    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618551    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618555    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 21:48:40.624370 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618557    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618560    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618563    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618567    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618570    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618573    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618576    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618578    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618581    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618584    2580 flags.go:64] FLAG: --feature-gates=""
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618588    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618590    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618593    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618596    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618599    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618602    2580 flags.go:64] FLAG: --help="false"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618617    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618621    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618624    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618627    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618630    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618634    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618637    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 21:48:40.624946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618641    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618643    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618646    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618649    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618652    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618655    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618658    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618661    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618664    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618667    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618669    2580 flags.go:64] FLAG: --lock-file=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618672    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618676    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618679    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618685    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618687    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618690    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618693    2580 flags.go:64] FLAG: --logging-format="text"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618696    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618699    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618702    2580 flags.go:64] FLAG: --manifest-url=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618705    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618709    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618712    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618716    2580 flags.go:64] FLAG: --max-pods="110"
Sep 16 21:48:40.625622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618720    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618723    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618725    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618729    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618732    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618735    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618739    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618746    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618750    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618753    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618756    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618758    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618764    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618767    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618770    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618772    2580 flags.go:64] FLAG: --port="10250"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618775    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618778    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a59df500d134e8c9"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618781    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618786    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618789    2580 flags.go:64] FLAG: --register-node="true"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618792    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618796    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618805    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 16 21:48:40.626598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618808    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618811    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618815    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618818    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618821    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618824    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618827    2580 flags.go:64] FLAG: --runonce="false"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618830    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618833    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618837    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618839    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618842    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618846    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618849    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618852    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618855    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618858    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618861    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618864    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618866    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618869    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618872    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618877    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618880    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618883    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 21:48:40.627523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618886    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618889    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618893    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618896    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618899    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618902    2580 flags.go:64] FLAG: --v="2"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618906    2580 flags.go:64] FLAG: --version="false"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618909    2580 flags.go:64] FLAG: --vmodule=""
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618913    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.618916    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619043    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619047    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619050    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619053    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619055    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619058    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619060    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619063    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619065    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619068    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619071    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619073    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.628441 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619078    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619080    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619083    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619085    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619088    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619091    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619093    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619095    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619098    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619101    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619103    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619106    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619110    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619112    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619114    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619117    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619119    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619122    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619125    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.629031 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619127    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619131    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619134    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619137    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619139    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619142    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619145    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619148    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619150    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619152    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619155    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619157    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619160    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619164    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619168    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619171    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619174    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619177    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619179    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.629496 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619182    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619184    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619187    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619190    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619192    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619194    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619198    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619201    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619203    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619206    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619208    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619211    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619213    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619216    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619218    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619221    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619223    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619226    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619228    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619231    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.630002 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619233    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619236    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619238    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619240    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619243    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619245    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619250    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619252    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619255    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619259    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619262    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619265    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619267    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619270    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619273    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619275    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619278    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619280    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619284    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619286    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.630485 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619289    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619291    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619294    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619296    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619299    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619302    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619304    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619307    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.619309    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.619314    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.629720    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.629739    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.629764    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.629773    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629829    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.630996 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629835    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629838    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629842    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629844    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629847    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629850    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629854    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629858    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629861    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629864    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629867    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629870    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629873    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629875    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629878    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629881    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629884    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629887    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629889    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.631374 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629892    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629895    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629897    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629900    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629902    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629905    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629908    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629911    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629913    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629916    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629919    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629922    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629925    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629927    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629930    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629933    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629935    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629938    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629940    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629943    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.631844 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629945    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629948    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629950    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629953    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629955    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629958    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629962    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629965    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629968    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629971    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629974    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629976    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629979    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629981    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629985    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629988    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629991    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629994    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.629997    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.632323 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630000    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630002    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630005    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630008    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630011    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630014    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630017    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630019    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630022    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630024    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630027    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630030    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630033    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630036    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630038    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630041    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630044    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630047    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630049    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630052    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.632796 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630055    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630058    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630061    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630063    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630066    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630068    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630071    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630073    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630076    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630079    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630081    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630084    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630086    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630089    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630092    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630095    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630098    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630100    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630103    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.633305 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630105    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.630110    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630234    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630238    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630241    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630244    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630247    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630249    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630252    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630254    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630257    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630259    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630262    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630264    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 21:48:40.633777 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630267    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630272    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630276    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630278    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630281    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630284    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630286    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630289    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630291    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630294    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630298    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630301    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630304    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630307    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630311    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630313    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630316    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630318    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630321    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 21:48:40.634117 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630324    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630326    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630329    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630332    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630334    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630337    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630339    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630342    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630344    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630347    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630350    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630352    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630354    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630357    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630360    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630363    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630366    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630368    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630371    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630373    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 21:48:40.634589 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630375    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630378    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630380    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630383    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630385    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630388    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630391    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630393    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630396    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630398    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630401    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630403    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630407    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630410    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630413    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630415    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630417    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630420    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630422    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630425    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 21:48:40.635096 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630427    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630430    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630433    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630435    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630438    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630440    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630442    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630446    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630448    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630451    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630453    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630456    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630458    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630461    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630463    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630466    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630468    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630471    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630474    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630476    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 21:48:40.635577 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630478    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630481    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630484    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630486    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630489    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630492    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630495    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:40.630497    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.630502    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.630621    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.634515    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.635562    2580 server.go:1019] "Starting client certificate rotation"
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.635647    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 21:48:40.636086 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.635683    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 21:48:40.638556 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.638542    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 21:48:40.639818 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.639791    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 21:48:40.656479 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.656446    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 16 21:48:40.659981 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.659966    2580 log.go:25] "Validated CRI v1 image API"
Sep 16 21:48:40.660997 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.660971    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 21:48:40.667397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.667371    2580 fs.go:135] Filesystem UUIDs: map[35a0a561-bcfa-49af-a1ed-3145d3f71881:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 eca0f897-d260-4536-91b6-e44a30847476:/dev/nvme0n1p3]
Sep 16 21:48:40.667476 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.667396    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 21:48:40.672049 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.672018    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 21:48:40.675180 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.675067    2580 manager.go:216] Machine: {Timestamp:2026-09-16 21:48:40.673721804 +0000 UTC m=+0.349910272 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200786 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ea41d24e8fb191a61c10f936e8a0 SystemUUID:ec26ea41-d24e-8fb1-91a6-1c10f936e8a0 BootID:8fbdd598-73e0-4db2-a857-68cab60dd8e4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e4:fe:06:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e4:fe:06:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:31:23:97:7e:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 21:48:40.675180 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.675173    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 21:48:40.675303 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.675258    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 21:48:40.679285 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.679262    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 21:48:40.679423 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.679288    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 21:48:40.680302 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.680292    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 21:48:40.680333 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.680306    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 21:48:40.680333 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.680313    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 21:48:40.681189 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.681179    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 21:48:40.682398 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.682388    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 21:48:40.686772 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686761    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 21:48:40.686892 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686883    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 21:48:40.686929 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686912    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 21:48:40.686929 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686922    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 21:48:40.686984 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686939    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 21:48:40.686984 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686948    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 16 21:48:40.686984 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.686956    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 21:48:40.687321 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.687310    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 21:48:40.687362 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.687339    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 21:48:40.689752 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.689737    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 21:48:40.692117 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.692104    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 21:48:40.692168 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.692134    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 21:48:40.694386 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694365    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 21:48:40.694386 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694383    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694389    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694395    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694403    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694409    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694427    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694433    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694440    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694445    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 21:48:40.694456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694458    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 21:48:40.694702 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.694465    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 21:48:40.696198 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.696187    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 21:48:40.696198 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.696198    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 21:48:40.699505 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.699487    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 21:48:40.699654 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.699634    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 21:48:40.699774 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.699755    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 21:48:40.700619 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.700599    2580 server.go:1268] "Started kubelet"
Sep 16 21:48:40.700704 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.700679    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 21:48:40.700810 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.700747    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 21:48:40.700857 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.700835    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 21:48:40.701694 ip-10-0-129-128 systemd[1]: Started Kubernetes Kubelet.
Sep 16 21:48:40.703043 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.703017    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 21:48:40.703294 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.703276    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 21:48:40.705303 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.705283    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 21:48:40.706970 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.705917    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-128.ec2.internal.18d5eb76660ee226  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-128.ec2.internal,UID:ip-10-0-129-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-128.ec2.internal,},FirstTimestamp:2026-09-16 21:48:40.70055991 +0000 UTC m=+0.376748378,LastTimestamp:2026-09-16 21:48:40.70055991 +0000 UTC m=+0.376748378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-128.ec2.internal,}"
Sep 16 21:48:40.709205 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.709181    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8vww"
Sep 16 21:48:40.710949 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.710932    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 21:48:40.711570 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.711555    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 21:48:40.711842 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.711823    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:40.712439 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712423    2580 factory.go:55] Registering systemd factory
Sep 16 21:48:40.712439 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712438    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 21:48:40.712564 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712445    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 21:48:40.712564 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712463    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 21:48:40.712564 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712465    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 16 21:48:40.712715 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712568    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 21:48:40.712715 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712575    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 21:48:40.712715 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712675    2580 factory.go:153] Registering CRI-O factory
Sep 16 21:48:40.712715 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712689    2580 factory.go:223] Registration of the crio container factory successfully
Sep 16 21:48:40.712846 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712737    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 21:48:40.712846 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712750    2580 factory.go:103] Registering Raw factory
Sep 16 21:48:40.712846 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.712760    2580 manager.go:1196] Started watching for new ooms in manager
Sep 16 21:48:40.713388 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.713372    2580 manager.go:349] Starting recovery of all containers
Sep 16 21:48:40.714766 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.714733    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 21:48:40.714868 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.714846    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 21:48:40.716173 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.716148    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v8vww"
Sep 16 21:48:40.726244 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.726224    2580 manager.go:354] Recovery completed
Sep 16 21:48:40.732113 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.732100    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:40.733902 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.733885    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:40.733975 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.733920    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:40.733975 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.733935    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:40.734548 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.734533    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 21:48:40.734548 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.734543    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:40.734548 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.734548    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 21:48:40.734713 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.734566    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 21:48:40.736185 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.736002    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-128.ec2.internal.18d5eb76680ba646  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-128.ec2.internal,UID:ip-10-0-129-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-128.ec2.internal,},FirstTimestamp:2026-09-16 21:48:40.733902406 +0000 UTC m=+0.410090882,LastTimestamp:2026-09-16 21:48:40.733902406 +0000 UTC m=+0.410090882,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-128.ec2.internal,}"
Sep 16 21:48:40.736362 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736337    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:40.736478 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736386    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:40.736478 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736412    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:40.736697 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736682    2580 policy_none.go:49] "None policy: Start"
Sep 16 21:48:40.736740 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736705    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 21:48:40.736740 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.736716    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 21:48:40.812071 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.812036    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:40.882193 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.881757    2580 policy_none.go:47] "Start"
Sep 16 21:48:40.912671 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.912653    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:40.919597 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.919574    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-128.ec2.internal\" not found" node="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:40.927203 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.927191    2580 manager.go:337] "Starting Device Plugin manager"
Sep 16 21:48:40.927261 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.927228    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 21:48:40.927261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.927237    2580 server.go:87] "Starting device plugin registration server"
Sep 16 21:48:40.927629 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.927599    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 21:48:40.927728 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.927629    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 21:48:40.927794 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.927730    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 21:48:40.928310 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.928295    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 21:48:40.928310 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.928310    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 21:48:40.928456 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.928412    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 21:48:40.928456 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.928455    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:40.950584 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.950548    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 21:48:40.951804 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.951779    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 21:48:40.951882 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.951839    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 21:48:40.951882 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.951866    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 21:48:40.951968 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:40.951947    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 21:48:40.954147 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:40.953943    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:41.027863 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.027837    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:41.028810 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.028795    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:41.028870 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.028824    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:41.028870 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.028835    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:41.028870 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.028858    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.035125 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.035110    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.035190 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.035131    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-128.ec2.internal\": node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.052807 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.052789    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"]
Sep 16 21:48:41.052899 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.052845    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:41.054493 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.054480    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:41.054573 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.054509    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:41.054573 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.054523    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:41.056849 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.056836    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:41.056975 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.056961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.057031 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.056996    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:41.057525 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057509    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:41.057601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057536    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:41.057601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057541    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:41.057601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057551    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:41.057601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057557    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:41.057601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.057570    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:41.059539 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.059513    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.059916 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.059884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.059916 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.059907    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 21:48:41.060592 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.060576    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 21:48:41.060685 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.060621    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 21:48:41.060685 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.060633    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeHasSufficientPID"
Sep 16 21:48:41.080238 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.080214    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-128.ec2.internal\" not found" node="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.084412 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.084396    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-128.ec2.internal\" not found" node="ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.115716 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.115690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.115716 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.115717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.115859 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.115735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4beacb691c0810bb4c0ae6ade1dd54cb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-128.ec2.internal\" (UID: \"4beacb691c0810bb4c0ae6ade1dd54cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.160077 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.159994    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.216622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4beacb691c0810bb4c0ae6ade1dd54cb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-128.ec2.internal\" (UID: \"4beacb691c0810bb4c0ae6ade1dd54cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.216732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.216732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.216732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.216856 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4beacb691c0810bb4c0ae6ade1dd54cb-config\") pod \"kube-apiserver-proxy-ip-10-0-129-128.ec2.internal\" (UID: \"4beacb691c0810bb4c0ae6ade1dd54cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.216856 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.216720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5886ca90be0fa8514986e28d2ce49575-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal\" (UID: \"5886ca90be0fa8514986e28d2ce49575\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.260691 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.260662    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.361684 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.361652    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.383468 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.383435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.386802 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.386782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:41.463557 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.463470    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.559127 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.559102    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:41.563744 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.563721    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.635573 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.635524    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 21:48:41.636129 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.635735    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 21:48:41.636129 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.635735    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 21:48:41.665045 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.665003    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.723185 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.723117    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 21:43:40 +0000 UTC" deadline="2028-06-09 16:46:06.612507456 +0000 UTC"
Sep 16 21:48:41.723185 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:41.723147    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15162h57m24.889363155s"
Sep 16 21:48:41.765764 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.765719    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.866665 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.866620    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:41.966945 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:41.966910    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:42.068104 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.068070    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:42.168780 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.168738    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-128.ec2.internal\" not found"
Sep 16 21:48:42.182332 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.182310    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:42.196694 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.196672    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:48:42.231391 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.231362    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:42.315005 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.314906    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:42.328860 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.328834    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 21:48:42.329830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.329813    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal"
Sep 16 21:48:42.338374 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.338357    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 21:48:42.689593 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.689511    2580 apiserver.go:52] "Watching apiserver"
Sep 16 21:48:42.698072 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.698050    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 21:48:42.699110 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.699089    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-w9hp6","kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lnj4x","openshift-dns/node-resolver-pd2w7","openshift-multus/multus-additional-cni-plugins-mbcb6","openshift-multus/multus-mx9ts","openshift-multus/network-metrics-daemon-h9wtn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7","openshift-image-registry/node-ca-jhjbv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal","openshift-network-diagnostics/network-check-target-nhg7b","openshift-network-operator/iptables-alerter-2z6f7","openshift-ovn-kubernetes/ovnkube-node-k8n4z","kube-system/global-pull-secret-syncer-g8bwq"]
Sep 16 21:48:42.703109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.703092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.703221 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.703200    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:42.705466 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.705450    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.707811 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.707789    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.708080 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 21:48:42.708212 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708193    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 21:48:42.708363 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kgd62\""
Sep 16 21:48:42.708503 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.708547 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708496    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.708584 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.708545    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 21:48:42.711112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.709380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 21:48:42.711112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.710340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9ld75\""
Sep 16 21:48:42.711112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.710384    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.711112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.710997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.711112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.711106    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 21:48:42.711751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.711734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.714382 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.714358    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.714741 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.714715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dnm92\""
Sep 16 21:48:42.714854 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.714722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.714854 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.714764    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.717175 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717156    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 21:48:42.717286 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 21:48:42.717356 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717298    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 21:48:42.717411 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.717468 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8w97j\""
Sep 16 21:48:42.717468 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.717622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.717608    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.719949 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.719930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.720195 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.720177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kbhhr\""
Sep 16 21:48:42.720195 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.720187    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 21:48:42.722312 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.722296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.722411 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.722370    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 21:48:42.722563 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.722544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.722680 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.722591    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.722680 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.722657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-55zl7\""
Sep 16 21:48:42.724611 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-systemd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.724727 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.724727 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-modprobe-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.724727 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-sys\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.724866 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.724866 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724784    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msnqg\" (UniqueName: \"kubernetes.io/projected/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-kube-api-access-msnqg\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.724866 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.724866 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.724822    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-netd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-config\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-conf\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724936    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xsccz\""
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqrrr\" (UniqueName: \"kubernetes.io/projected/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-kube-api-access-wqrrr\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.724983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-system-cni-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725058 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725068    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725067    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-kubelet\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-systemd-units\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-tmp-dir\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.725337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4vd\" (UniqueName: \"kubernetes.io/projected/82bad579-3540-4c3e-af21-67edf91dbf8d-kube-api-access-rm4vd\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-etc-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-bin\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-script-lib\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-host\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysconfig\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-env-overrides\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-systemd\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-lib-modules\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvmf\" (UniqueName: \"kubernetes.io/projected/b63a5289-64ed-4b53-b249-a72818c21dfc-kube-api-access-mfvmf\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-ovn\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-run\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.725655 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725658    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-var-lib-kubelet\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-tmp\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-hosts-file\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-cnibin\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-slash\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-var-lib-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42eaed63-8030-4248-aa8a-ec43dff35f21-ovn-node-metrics-cert\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-tuned\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-node-log\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725810    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-log-socket\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68vf\" (UniqueName: \"kubernetes.io/projected/42eaed63-8030-4248-aa8a-ec43dff35f21-kube-api-access-q68vf\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-kubernetes\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.726115 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.725924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-netns\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.726604 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.726231    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 21:48:42.727420 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.727401    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.729739 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.729719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 21:48:42.729843 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.729759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:42.729843 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.729818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:42.729993 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.729977    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.730060 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.730034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-85kdw\""
Sep 16 21:48:42.730098 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.730089    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.732222 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.732202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.734695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.734662    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 21:48:42.734695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.734673    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 21:48:42.734940 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.734926    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g4rzs\""
Sep 16 21:48:42.734995 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.734947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 21:48:42.743965 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.743945    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t54h6"
Sep 16 21:48:42.752242 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.752223    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t54h6"
Sep 16 21:48:42.791438 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.791403    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:42.814447 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.814416    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 21:48:42.826329 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-log-socket\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826329 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68vf\" (UniqueName: \"kubernetes.io/projected/42eaed63-8030-4248-aa8a-ec43dff35f21-kube-api-access-q68vf\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826329 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-registration-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.826329 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-log-socket\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-kubernetes\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-netns\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-systemd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-sys\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msnqg\" (UniqueName: \"kubernetes.io/projected/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-kube-api-access-msnqg\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-system-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-cni-binary-copy\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-config\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-socket-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-kubernetes\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-netns\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-systemd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.826695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-sys\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmjp8\" (UniqueName: \"kubernetes.io/projected/f04ddf9b-db10-46e4-9a86-323b65be6cce-kube-api-access-jmjp8\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-hostroot\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826923    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed852582-836e-41d9-99c7-050a18dde47d-konnectivity-ca\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.826981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4vd\" (UniqueName: \"kubernetes.io/projected/82bad579-3540-4c3e-af21-67edf91dbf8d-kube-api-access-rm4vd\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-bin\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-script-lib\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827082    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-host\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.827152    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:42.827383 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.827245    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:48:43.327220614 +0000 UTC m=+3.003409081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-env-overrides\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-systemd\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-config\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-host\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-systemd\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-lib-modules\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827422    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-bin\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-sys-fs\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-socket-dir-parent\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-etc-kubernetes\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-ovn\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-env-overrides\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-run\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-hosts-file\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-cnibin\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.828190 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/295d2cae-f99d-4964-aa75-622967559cfb-serviceca\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827633    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-lib-modules\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-ovn\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42eaed63-8030-4248-aa8a-ec43dff35f21-ovnkube-script-lib\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-run\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-var-lib-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827717    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-cnibin\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-hosts-file\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5ws7\" (UniqueName: \"kubernetes.io/projected/6d647fe9-0235-4dac-b22f-469fa378e6a3-kube-api-access-k5ws7\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-node-log\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-var-lib-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwdcd\" (UniqueName: \"kubernetes.io/projected/295d2cae-f99d-4964-aa75-622967559cfb-kube-api-access-fwdcd\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-node-log\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-bin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqrrr\" (UniqueName: \"kubernetes.io/projected/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-kube-api-access-wqrrr\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-system-cni-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.828986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-modprobe-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.827986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-device-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-netns\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-netd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-conf\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-modprobe-d\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-cni-netd\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b63a5289-64ed-4b53-b249-a72818c21dfc-system-cni-dir\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-daemon-config\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-kubelet-config\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a244c1-2909-4047-8670-40b82ae699a1-host-slash\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.829803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-kubelet\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysctl-conf\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-systemd-units\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-run-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b63a5289-64ed-4b53-b249-a72818c21dfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-tmp-dir\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-run-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-systemd-units\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-kubelet\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcgj5\" (UniqueName: \"kubernetes.io/projected/22a244c1-2909-4047-8670-40b82ae699a1-kube-api-access-kcgj5\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-etc-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvmf\" (UniqueName: \"kubernetes.io/projected/b63a5289-64ed-4b53-b249-a72818c21dfc-kube-api-access-mfvmf\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/295d2cae-f99d-4964-aa75-622967559cfb-host\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828725    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed852582-836e-41d9-99c7-050a18dde47d-agent-certs\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.830534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-etc-openvswitch\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-multus\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysconfig\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-tmp-dir\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-sysconfig\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-conf-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-var-lib-kubelet\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-tmp\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-cnibin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.828998    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-multus-certs\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a244c1-2909-4047-8670-40b82ae699a1-iptables-alerter-script\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-slash\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829100    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42eaed63-8030-4248-aa8a-ec43dff35f21-ovn-node-metrics-cert\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-tuned\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-k8s-cni-cncf-io\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-kubelet\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-dbus\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.831323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-var-lib-kubelet\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.832160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42eaed63-8030-4248-aa8a-ec43dff35f21-host-slash\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.832160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.829794    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 21:48:42.834005 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.833980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-tmp\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.834129 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.833988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42eaed63-8030-4248-aa8a-ec43dff35f21-ovn-node-metrics-cert\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.834129 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.834042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-etc-tuned\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.835290 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.835261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msnqg\" (UniqueName: \"kubernetes.io/projected/5ab408bf-ff44-44e3-b38f-9f7235cdcd89-kube-api-access-msnqg\") pod \"tuned-lnj4x\" (UID: \"5ab408bf-ff44-44e3-b38f-9f7235cdcd89\") " pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:42.836199 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.836174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68vf\" (UniqueName: \"kubernetes.io/projected/42eaed63-8030-4248-aa8a-ec43dff35f21-kube-api-access-q68vf\") pod \"ovnkube-node-k8n4z\" (UID: \"42eaed63-8030-4248-aa8a-ec43dff35f21\") " pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:42.841941 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.841894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqrrr\" (UniqueName: \"kubernetes.io/projected/faed1203-1b10-4f5b-bfbd-83eaaaa218e8-kube-api-access-wqrrr\") pod \"node-resolver-pd2w7\" (UID: \"faed1203-1b10-4f5b-bfbd-83eaaaa218e8\") " pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:42.842170 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.842149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvmf\" (UniqueName: \"kubernetes.io/projected/b63a5289-64ed-4b53-b249-a72818c21dfc-kube-api-access-mfvmf\") pod \"multus-additional-cni-plugins-mbcb6\" (UID: \"b63a5289-64ed-4b53-b249-a72818c21dfc\") " pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:42.842480 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.842457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4vd\" (UniqueName: \"kubernetes.io/projected/82bad579-3540-4c3e-af21-67edf91dbf8d-kube-api-access-rm4vd\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:42.930217 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-device-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.930217 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-netns\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-daemon-config\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-kubelet-config\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a244c1-2909-4047-8670-40b82ae699a1-host-slash\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcgj5\" (UniqueName: \"kubernetes.io/projected/22a244c1-2909-4047-8670-40b82ae699a1-kube-api-access-kcgj5\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/295d2cae-f99d-4964-aa75-622967559cfb-host\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.930514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed852582-836e-41d9-99c7-050a18dde47d-agent-certs\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-multus\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-conf-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-cnibin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-multus-certs\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a244c1-2909-4047-8670-40b82ae699a1-iptables-alerter-script\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-k8s-cni-cncf-io\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-kubelet\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-dbus\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-registration-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-system-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-cni-binary-copy\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-socket-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmjp8\" (UniqueName: \"kubernetes.io/projected/f04ddf9b-db10-46e4-9a86-323b65be6cce-kube-api-access-jmjp8\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-hostroot\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed852582-836e-41d9-99c7-050a18dde47d-konnectivity-ca\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.931013 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-daemon-config\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-sys-fs\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-socket-dir-parent\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931085    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-netns\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-etc-kubernetes\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/295d2cae-f99d-4964-aa75-622967559cfb-serviceca\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ws7\" (UniqueName: \"kubernetes.io/projected/6d647fe9-0235-4dac-b22f-469fa378e6a3-kube-api-access-k5ws7\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwdcd\" (UniqueName: \"kubernetes.io/projected/295d2cae-f99d-4964-aa75-622967559cfb-kube-api-access-fwdcd\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-bin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-kubelet\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.930361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-device-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-etc-selinux\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-dbus\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-registration-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-system-cni-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.931833 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/295d2cae-f99d-4964-aa75-622967559cfb-host\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.931964    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d647fe9-0235-4dac-b22f-469fa378e6a3-cni-binary-copy\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-socket-dir-parent\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932121    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-etc-kubernetes\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932134    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-cnibin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932154    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-sys-fs\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-multus\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-multus-conf-dir\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a244c1-2909-4047-8670-40b82ae699a1-host-slash\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-k8s-cni-cncf-io\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-var-lib-cni-bin\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c43b2736-e9b7-4461-97fe-c42c066e1770-kubelet-config\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed852582-836e-41d9-99c7-050a18dde47d-konnectivity-ca\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.932714 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-hostroot\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6d647fe9-0235-4dac-b22f-469fa378e6a3-host-run-multus-certs\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.932977    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.932985    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f04ddf9b-db10-46e4-9a86-323b65be6cce-socket-dir\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.933040    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:43.433024416 +0000 UTC m=+3.109212873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.933062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/295d2cae-f99d-4964-aa75-622967559cfb-serviceca\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.933367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.933201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a244c1-2909-4047-8670-40b82ae699a1-iptables-alerter-script\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.936224 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.936201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed852582-836e-41d9-99c7-050a18dde47d-agent-certs\") pod \"konnectivity-agent-w9hp6\" (UID: \"ed852582-836e-41d9-99c7-050a18dde47d\") " pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:42.939749 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.939141    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:42.939749 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.939170    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:42.939749 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.939187    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:42.939749 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:42.939296    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:43.43927603 +0000 UTC m=+3.115464510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:42.940894 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.940868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcgj5\" (UniqueName: \"kubernetes.io/projected/22a244c1-2909-4047-8670-40b82ae699a1-kube-api-access-kcgj5\") pod \"iptables-alerter-2z6f7\" (UID: \"22a244c1-2909-4047-8670-40b82ae699a1\") " pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:42.941362 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.941342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5ws7\" (UniqueName: \"kubernetes.io/projected/6d647fe9-0235-4dac-b22f-469fa378e6a3-kube-api-access-k5ws7\") pod \"multus-mx9ts\" (UID: \"6d647fe9-0235-4dac-b22f-469fa378e6a3\") " pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:42.942547 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.942469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwdcd\" (UniqueName: \"kubernetes.io/projected/295d2cae-f99d-4964-aa75-622967559cfb-kube-api-access-fwdcd\") pod \"node-ca-jhjbv\" (UID: \"295d2cae-f99d-4964-aa75-622967559cfb\") " pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:42.944102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.944079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmjp8\" (UniqueName: \"kubernetes.io/projected/f04ddf9b-db10-46e4-9a86-323b65be6cce-kube-api-access-jmjp8\") pod \"aws-ebs-csi-driver-node-ddlp7\" (UID: \"f04ddf9b-db10-46e4-9a86-323b65be6cce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:42.962575 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.962123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal" event={"ID":"4beacb691c0810bb4c0ae6ade1dd54cb","Type":"ContainerStarted","Data":"f3f6c1f660d7bb63408b72d9b8d2cb81caa79bc4ff8d3cb781522291265c7f5f"}
Sep 16 21:48:42.962575 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:42.962244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal" event={"ID":"5886ca90be0fa8514986e28d2ce49575","Type":"ContainerStarted","Data":"4ee33714e8cd227afe9350428ccd04d3f1bcd31f9014f6ec4497efea7beb4c09"}
Sep 16 21:48:43.017898 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.017858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:48:43.025141 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.025108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lnj4x"
Sep 16 21:48:43.031944 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.031807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd2w7"
Sep 16 21:48:43.037975 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.037949    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mbcb6"
Sep 16 21:48:43.042060 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.042025    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42eaed63_8030_4248_aa8a_ec43dff35f21.slice/crio-804e2e49b7223bd7ac431e0c8467411998546e72fff1dd40628d2b44a08174fb WatchSource:0}: Error finding container 804e2e49b7223bd7ac431e0c8467411998546e72fff1dd40628d2b44a08174fb: Status 404 returned error can't find the container with id 804e2e49b7223bd7ac431e0c8467411998546e72fff1dd40628d2b44a08174fb
Sep 16 21:48:43.043349 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.043330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mx9ts"
Sep 16 21:48:43.048901 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.048876    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jhjbv"
Sep 16 21:48:43.049855 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.049788    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaed1203_1b10_4f5b_bfbd_83eaaaa218e8.slice/crio-cde7eefce3de0b3b777c53a5314417f08f38441abdc5cd92cf45fabba8d99995 WatchSource:0}: Error finding container cde7eefce3de0b3b777c53a5314417f08f38441abdc5cd92cf45fabba8d99995: Status 404 returned error can't find the container with id cde7eefce3de0b3b777c53a5314417f08f38441abdc5cd92cf45fabba8d99995
Sep 16 21:48:43.050136 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.050112    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab408bf_ff44_44e3_b38f_9f7235cdcd89.slice/crio-dcf5a99464646c30d8d2a7bf8109f1d71527e7a3b33d2d78860c46da5cd62b1b WatchSource:0}: Error finding container dcf5a99464646c30d8d2a7bf8109f1d71527e7a3b33d2d78860c46da5cd62b1b: Status 404 returned error can't find the container with id dcf5a99464646c30d8d2a7bf8109f1d71527e7a3b33d2d78860c46da5cd62b1b
Sep 16 21:48:43.055619 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.055596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:48:43.060705 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.060686    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7"
Sep 16 21:48:43.066156 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.066129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295d2cae_f99d_4964_aa75_622967559cfb.slice/crio-2ddff75f3cca232d2f7a36b0c03bb81d2018191b724a356be1c1d6bdf6fef7f3 WatchSource:0}: Error finding container 2ddff75f3cca232d2f7a36b0c03bb81d2018191b724a356be1c1d6bdf6fef7f3: Status 404 returned error can't find the container with id 2ddff75f3cca232d2f7a36b0c03bb81d2018191b724a356be1c1d6bdf6fef7f3
Sep 16 21:48:43.066349 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.066197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2z6f7"
Sep 16 21:48:43.072551 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.072523    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded852582_836e_41d9_99c7_050a18dde47d.slice/crio-b49d9b5a36a7a1950271d4500d85c178488b524d01166bc989434f75659ecbbb WatchSource:0}: Error finding container b49d9b5a36a7a1950271d4500d85c178488b524d01166bc989434f75659ecbbb: Status 404 returned error can't find the container with id b49d9b5a36a7a1950271d4500d85c178488b524d01166bc989434f75659ecbbb
Sep 16 21:48:43.078253 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.078225    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04ddf9b_db10_46e4_9a86_323b65be6cce.slice/crio-dc0c7b512eefc8257829404d2e11db0d0f89c3793af8505fe66aeedc8282ae64 WatchSource:0}: Error finding container dc0c7b512eefc8257829404d2e11db0d0f89c3793af8505fe66aeedc8282ae64: Status 404 returned error can't find the container with id dc0c7b512eefc8257829404d2e11db0d0f89c3793af8505fe66aeedc8282ae64
Sep 16 21:48:43.084073 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:48:43.083837    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a244c1_2909_4047_8670_40b82ae699a1.slice/crio-3b427e10e62f51c9fb701d11f560b20261d1fa9c109e0c381790a2552a84ea3b WatchSource:0}: Error finding container 3b427e10e62f51c9fb701d11f560b20261d1fa9c109e0c381790a2552a84ea3b: Status 404 returned error can't find the container with id 3b427e10e62f51c9fb701d11f560b20261d1fa9c109e0c381790a2552a84ea3b
Sep 16 21:48:43.334746 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.334647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:43.334908 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.334794    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:43.334908 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.334869    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:48:44.334849138 +0000 UTC m=+4.011037613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:43.435340 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.435301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:43.435511 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.435467    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:43.435556 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.435541    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:44.435526424 +0000 UTC m=+4.111714899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:43.536512 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.536474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:43.536706 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.536641    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:43.536706 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.536664    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:43.536706 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.536676    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:43.536871 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.536740    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:44.536722406 +0000 UTC m=+4.212910883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:43.755187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.755095    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 21:48:43.755187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.755124    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:43:42 +0000 UTC" deadline="2028-04-16 05:09:05.064148779 +0000 UTC"
Sep 16 21:48:43.755187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.755173    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13855h20m21.308979449s"
Sep 16 21:48:43.952830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.952801    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:43.953009 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.952915    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:43.953009 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.952970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:43.953133 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:43.953111    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:43.964135 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.964106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2z6f7" event={"ID":"22a244c1-2909-4047-8670-40b82ae699a1","Type":"ContainerStarted","Data":"3b427e10e62f51c9fb701d11f560b20261d1fa9c109e0c381790a2552a84ea3b"}
Sep 16 21:48:43.965382 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.965347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7" event={"ID":"f04ddf9b-db10-46e4-9a86-323b65be6cce","Type":"ContainerStarted","Data":"dc0c7b512eefc8257829404d2e11db0d0f89c3793af8505fe66aeedc8282ae64"}
Sep 16 21:48:43.966549 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.966526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w9hp6" event={"ID":"ed852582-836e-41d9-99c7-050a18dde47d","Type":"ContainerStarted","Data":"b49d9b5a36a7a1950271d4500d85c178488b524d01166bc989434f75659ecbbb"}
Sep 16 21:48:43.967726 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.967701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhjbv" event={"ID":"295d2cae-f99d-4964-aa75-622967559cfb","Type":"ContainerStarted","Data":"2ddff75f3cca232d2f7a36b0c03bb81d2018191b724a356be1c1d6bdf6fef7f3"}
Sep 16 21:48:43.968862 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.968832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerStarted","Data":"e702fc138b3a6dcbbd1b4f2a580172833c36e8eaf6d147cc648659a44b83b16d"}
Sep 16 21:48:43.970066 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.970043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd2w7" event={"ID":"faed1203-1b10-4f5b-bfbd-83eaaaa218e8","Type":"ContainerStarted","Data":"cde7eefce3de0b3b777c53a5314417f08f38441abdc5cd92cf45fabba8d99995"}
Sep 16 21:48:43.971309 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.971285    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"804e2e49b7223bd7ac431e0c8467411998546e72fff1dd40628d2b44a08174fb"}
Sep 16 21:48:43.972551 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.972529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mx9ts" event={"ID":"6d647fe9-0235-4dac-b22f-469fa378e6a3","Type":"ContainerStarted","Data":"d37492411bef8cd762d5d42b30901b6e7a8038c15297933c5f770b2b14ad3eda"}
Sep 16 21:48:43.973715 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:43.973688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnj4x" event={"ID":"5ab408bf-ff44-44e3-b38f-9f7235cdcd89","Type":"ContainerStarted","Data":"dcf5a99464646c30d8d2a7bf8109f1d71527e7a3b33d2d78860c46da5cd62b1b"}
Sep 16 21:48:44.343684 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.343645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:44.343882 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.343791    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:44.343882 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.343855    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:48:46.343836257 +0000 UTC m=+6.020024735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:44.444394 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.444359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:44.444597 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.444575    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:44.444715 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.444694    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:46.444673995 +0000 UTC m=+6.120862467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:44.545548 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.545507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:44.545728 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.545711    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:44.545791 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.545735    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:44.545791 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.545750    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:44.545890 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.545807    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:46.545789558 +0000 UTC m=+6.221978018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:44.755578 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.755541    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 21:43:42 +0000 UTC" deadline="2028-02-28 08:50:26.174241603 +0000 UTC"
Sep 16 21:48:44.755578 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.755579    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12707h1m41.418666649s"
Sep 16 21:48:44.955301 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.952827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:44.955301 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:44.952970    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:44.980140 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:44.980102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal" event={"ID":"4beacb691c0810bb4c0ae6ade1dd54cb","Type":"ContainerStarted","Data":"fe8fb679ccbe6a4f7909f7ab27e1439592a4d9a6233f20df9b6725aaf988a561"}
Sep 16 21:48:45.953313 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:45.952372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:45.953313 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:45.952502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:45.953313 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:45.953103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:45.953313 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:45.953225    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:45.998048 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:45.998010    2580 generic.go:356] "Generic (PLEG): container finished" podID="5886ca90be0fa8514986e28d2ce49575" containerID="313685c1d9c82ecffb22e0952546071498f276b8ba6e3b1d1fd2b8e972c01a4a" exitCode=0
Sep 16 21:48:45.999214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:45.998966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal" event={"ID":"5886ca90be0fa8514986e28d2ce49575","Type":"ContainerDied","Data":"313685c1d9c82ecffb22e0952546071498f276b8ba6e3b1d1fd2b8e972c01a4a"}
Sep 16 21:48:46.017681 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:46.017266    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-128.ec2.internal" podStartSLOduration=4.017245422 podStartE2EDuration="4.017245422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:48:44.994398941 +0000 UTC m=+4.670587420" watchObservedRunningTime="2026-09-16 21:48:46.017245422 +0000 UTC m=+5.693433902"
Sep 16 21:48:46.362845 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:46.362760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:46.363044 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.362934    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:46.363044 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.363003    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:48:50.362984047 +0000 UTC m=+10.039172518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:46.463510 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:46.463444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:46.463746 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.463715    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:46.463833 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.463796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:50.463766449 +0000 UTC m=+10.139954915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:46.564410 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:46.564371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:46.564704 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.564573    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:46.564704 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.564595    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:46.564704 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.564622    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:46.564704 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.564680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:50.564663306 +0000 UTC m=+10.240851774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:46.952813 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:46.952735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:46.953005 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:46.952862    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:47.953592 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:47.952927    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:47.953592 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:47.953053    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:47.953592 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:47.953419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:47.953592 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:47.953527    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:48.953807 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:48.953319    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:48.953807 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:48.953454    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:49.952391 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:49.952205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:49.952391 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:49.952239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:49.952391 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:49.952366    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:49.952716 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:49.952494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:50.397669 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:50.396292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:50.397669 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.396532    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:50.397669 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.396619    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:48:58.39658522 +0000 UTC m=+18.072773696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:50.497471 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:50.497428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:50.497669 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.497582    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:50.497753 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.497660    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:58.497641221 +0000 UTC m=+18.173829694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:50.598569 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:50.598493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:50.598744 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.598669    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:50.598744 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.598693    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:50.598744 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.598705    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:50.598898 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.598764    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:48:58.598745634 +0000 UTC m=+18.274934107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:50.953337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:50.953307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:50.953580 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:50.953416    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:51.953176 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:51.953096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:51.953785 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:51.953272    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:51.953785 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:51.953329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:51.953785 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:51.953453    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:52.953001 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:52.952918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:52.953191 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:52.953060    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:53.952429 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:53.952403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:53.952429 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:53.952424    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:53.952587 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:53.952508    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:53.952670 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:53.952648    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:54.952351 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:54.952315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:54.952843 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:54.952446    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:55.952725 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:55.952687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:55.952725 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:55.952720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:55.953217 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:55.952845    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:55.953217 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:55.952988    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:56.952136 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:56.952101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:56.952301 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:56.952237    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:57.953098 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:57.953063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:57.953558 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:57.953125    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:57.953558 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:57.953186    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:57.953558 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:57.953248    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:48:58.457721 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:58.457688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:58.457919 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.457834    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:58.457919 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.457904    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.45788576 +0000 UTC m=+34.134074229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:48:58.558942 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:58.558907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:58.559106 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.559048    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:58.559144 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.559126    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.559104665 +0000 UTC m=+34.235293139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:48:58.659859 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:58.659817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:58.660041 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.660002    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:48:58.660041 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.660027    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:48:58.660041 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.660041    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:58.660178 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.660104    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.660085146 +0000 UTC m=+34.336273617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:48:58.952585 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:58.952547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:48:58.952764 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:58.952678    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:48:59.952369 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:59.952338    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:48:59.952369 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:48:59.952362    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:48:59.952877 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:59.952450    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:48:59.952877 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:48:59.952571    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:00.952990 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:00.952963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:00.953325 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:00.953044    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:01.952736 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:01.952323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:01.952736 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:01.952335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:01.952960 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:01.952771    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:01.952960 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:01.952819    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:02.032627 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.032567    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="ce44c8dca545f4df56fc6f34d0bc906ae2eda4552e5dda68fa9637899a453528" exitCode=0
Sep 16 21:49:02.032773 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.032638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"ce44c8dca545f4df56fc6f34d0bc906ae2eda4552e5dda68fa9637899a453528"}
Sep 16 21:49:02.035138 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.034769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd2w7" event={"ID":"faed1203-1b10-4f5b-bfbd-83eaaaa218e8","Type":"ContainerStarted","Data":"b0dba88d6bf230a2357d350295d8a90548bf0a2549dfa955161290c7198f41fb"}
Sep 16 21:49:02.038436 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"3f03810b5660517b35116333259395e5004a54ec1b7f0bb3d94be1f20524523d"}
Sep 16 21:49:02.038534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"47edbabf3048dd23d84395fe6d4b8cbc7227d756437719ad7618e05de2492dbb"}
Sep 16 21:49:02.038534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"5707786b52abc11e69af3903bc27005416bfffa4b8e61b6f43e3c04a36ac92c4"}
Sep 16 21:49:02.038648 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"0cda43dc8c7ad75d24c821d92103b11ac50e437487db41e598b36aa071b2f2a6"}
Sep 16 21:49:02.038648 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"996e22bac8844650f7da41293f34bc41ffa562179d99d06ea2d6dff3582b25cb"}
Sep 16 21:49:02.038728 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.038669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"0a265f5a29c0b7af937360d8679d903991218d7ed8bf53830b7265e225e33bec"}
Sep 16 21:49:02.040144 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.040121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mx9ts" event={"ID":"6d647fe9-0235-4dac-b22f-469fa378e6a3","Type":"ContainerStarted","Data":"3621b91c037e7ff032d87671f4ebdc9ffe75231df7a19e8f4c7b46b2d578e4b7"}
Sep 16 21:49:02.041849 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.041796    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lnj4x" event={"ID":"5ab408bf-ff44-44e3-b38f-9f7235cdcd89","Type":"ContainerStarted","Data":"f3f3cd4bd5e5b5d3fa79566b3bf1c4d5aab46a81ab1b856f57e3d66712450d3b"}
Sep 16 21:49:02.043728 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.043708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal" event={"ID":"5886ca90be0fa8514986e28d2ce49575","Type":"ContainerStarted","Data":"8abfa19af7e7b08c7bb95596ec89558ee2d0b346aa6a821ff4703d2edcbd54ee"}
Sep 16 21:49:02.045256 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.045233    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7" event={"ID":"f04ddf9b-db10-46e4-9a86-323b65be6cce","Type":"ContainerStarted","Data":"961306d19a0e063660079b2096cfbe7f2614feb75b0876269dd6df033292f02f"}
Sep 16 21:49:02.046840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.046812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w9hp6" event={"ID":"ed852582-836e-41d9-99c7-050a18dde47d","Type":"ContainerStarted","Data":"554b3e790117f2edc0b4c8c2b77e7a48e8a05237c7f21da77a62d3087c594603"}
Sep 16 21:49:02.048410 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.048338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jhjbv" event={"ID":"295d2cae-f99d-4964-aa75-622967559cfb","Type":"ContainerStarted","Data":"e6f35f374456a941d417395e67026adacf2b384a8f0ddec3286881c2e63065dc"}
Sep 16 21:49:02.080571 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.080516    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w9hp6" podStartSLOduration=3.341782655 podStartE2EDuration="21.080497294s" totalImagesPullingTime="17.738714639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.080486827 +0000 UTC m=+21.756675306" watchObservedRunningTime="2026-09-16 21:49:02.080497294 +0000 UTC m=+21.756685773"
Sep 16 21:49:02.080935 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.080911    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jhjbv" podStartSLOduration=3.062343964 podStartE2EDuration="21.080901417s" totalImagesPullingTime="18.018557453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.067900178 +0000 UTC m=+21.744088656" watchObservedRunningTime="2026-09-16 21:49:02.080901417 +0000 UTC m=+21.757089894"
Sep 16 21:49:02.095781 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.095734    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mx9ts" podStartSLOduration=3.006250948 podStartE2EDuration="21.095722293s" totalImagesPullingTime="18.089471345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.094990898 +0000 UTC m=+21.771179377" watchObservedRunningTime="2026-09-16 21:49:02.095722293 +0000 UTC m=+21.771910807"
Sep 16 21:49:02.109194 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.109156    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-128.ec2.internal" podStartSLOduration=20.109144046 podStartE2EDuration="20.109144046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.108792356 +0000 UTC m=+21.784980833" watchObservedRunningTime="2026-09-16 21:49:02.109144046 +0000 UTC m=+21.785332523"
Sep 16 21:49:02.123830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.123789    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lnj4x" podStartSLOduration=3.206113485 podStartE2EDuration="21.123775868s" totalImagesPullingTime="17.917662383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.123553799 +0000 UTC m=+21.799742276" watchObservedRunningTime="2026-09-16 21:49:02.123775868 +0000 UTC m=+21.799964324"
Sep 16 21:49:02.138004 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.137671    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pd2w7" podStartSLOduration=3.374492248 podStartE2EDuration="21.13765008s" totalImagesPullingTime="17.763157832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:02.137009922 +0000 UTC m=+21.813198394" watchObservedRunningTime="2026-09-16 21:49:02.13765008 +0000 UTC m=+21.813838558"
Sep 16 21:49:02.479876 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.479693    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 21:49:02.586212 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.586096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:49:02.586690 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.586672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:49:02.939599 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.939381    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T21:49:02.479855167Z","UUID":"91d1d91e-7c39-4446-b435-b2ea2082e57c","Handler":null,"Name":"","Endpoint":""}
Sep 16 21:49:02.941105 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.941078    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 21:49:02.941229 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.941114    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 21:49:02.952114 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:02.952088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:02.952257 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:02.952207    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:03.053060 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:03.053024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7" event={"ID":"f04ddf9b-db10-46e4-9a86-323b65be6cce","Type":"ContainerStarted","Data":"f9beeb27edfbfa59ac0f450b50f5028db0027a9f1c2cee5432b8cc202a957415"}
Sep 16 21:49:03.054751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:03.054712    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2z6f7" event={"ID":"22a244c1-2909-4047-8670-40b82ae699a1","Type":"ContainerStarted","Data":"fe41e858a714fd5115b413733ac736a871bd32344f61741601f1d2f202d773f1"}
Sep 16 21:49:03.068466 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:03.068416    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2z6f7" podStartSLOduration=4.052468291 podStartE2EDuration="22.068400813s" totalImagesPullingTime="18.015932522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:03.067991727 +0000 UTC m=+22.744180206" watchObservedRunningTime="2026-09-16 21:49:03.068400813 +0000 UTC m=+22.744589297"
Sep 16 21:49:03.953005 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:03.952805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:03.953005 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:03.952853    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:03.953005 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:03.952940    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:03.953266 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:03.953014    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:04.059692 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:04.059650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7" event={"ID":"f04ddf9b-db10-46e4-9a86-323b65be6cce","Type":"ContainerStarted","Data":"914304de3ab5fa10ce32d9d83a9119ad6f990f648cba68b0e2cfe71632d16c20"}
Sep 16 21:49:04.063517 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:04.063480    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 21:49:04.063690 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:04.063481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"dd2f19509d26b42f22cc2b0651cf9151e58e857b1f5ed08a394e0f8f2e8ed0a0"}
Sep 16 21:49:04.952163 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:04.952128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:04.952421 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:04.952265    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:05.952957 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:05.952928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:05.953324 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:05.953046    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:05.953324 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:05.953103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:05.953324 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:05.953201    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:06.953109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:06.953087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:06.953404 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:06.953192    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:07.073951 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.073694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" event={"ID":"42eaed63-8030-4248-aa8a-ec43dff35f21","Type":"ContainerStarted","Data":"2c9305302e3be3971c8909bbae821c8cf4569fead6e86b159543d5101ea74e03"}
Sep 16 21:49:07.073951 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.073950    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:07.074187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.073997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:07.074187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.074038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:07.089924 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.089897    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:07.090089 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.090000    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:07.098486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.098445    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ddlp7" podStartSLOduration=6.014575576 podStartE2EDuration="26.098427446s" totalImagesPullingTime="20.08385187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:04.07453596 +0000 UTC m=+23.750724438" watchObservedRunningTime="2026-09-16 21:49:07.098427446 +0000 UTC m=+26.774615925"
Sep 16 21:49:07.098716 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.098693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z" podStartSLOduration=7.846986461 podStartE2EDuration="26.09868648s" totalImagesPullingTime="18.251700019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:07.097008276 +0000 UTC m=+26.773196753" watchObservedRunningTime="2026-09-16 21:49:07.09868648 +0000 UTC m=+26.774874957"
Sep 16 21:49:07.214922 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.214895    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:49:07.215039 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.215024    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 21:49:07.215534 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.215508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w9hp6"
Sep 16 21:49:07.952563 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.952534    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:07.952722 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:07.952644    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:07.952722 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:07.952699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:07.952820 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:07.952792    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:08.076877 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.076848    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="a890bfdeea153b20465df67674cf5271c207f56d361a326f79fd2a400a1a3a76" exitCode=0
Sep 16 21:49:08.077602 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.076911    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"a890bfdeea153b20465df67674cf5271c207f56d361a326f79fd2a400a1a3a76"}
Sep 16 21:49:08.779644 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.779577    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9wtn"]
Sep 16 21:49:08.780047 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.779723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:08.780047 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:08.779853    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:08.783044 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.783012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhg7b"]
Sep 16 21:49:08.783186 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.783126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:08.783249 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:08.783230    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:08.783803 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.783767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8bwq"]
Sep 16 21:49:08.784448 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:08.783873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:08.784448 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:08.783964    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:10.083191 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:10.082987    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="fda14a1f59345dbd080e60480535cd761fea76f89388f7a2fc04fa7e0507f855" exitCode=0
Sep 16 21:49:10.083720 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:10.083062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"fda14a1f59345dbd080e60480535cd761fea76f89388f7a2fc04fa7e0507f855"}
Sep 16 21:49:10.953825 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:10.953778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:10.954024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:10.953866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:10.954024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:10.953904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:10.954024 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:10.953942    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:10.954024 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:10.953973    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:10.954184 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:10.954043    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:12.090257 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:12.090222    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="a13bb882d97c8239a2fca797f7539732aeb875f671a80a8d98493aedca5ba859" exitCode=0
Sep 16 21:49:12.090704 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:12.090273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"a13bb882d97c8239a2fca797f7539732aeb875f671a80a8d98493aedca5ba859"}
Sep 16 21:49:12.952091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:12.952056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:12.952091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:12.952070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:12.952091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:12.952057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:12.952399 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:12.952194    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:49:12.952399 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:12.952283    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g8bwq" podUID="c43b2736-e9b7-4461-97fe-c42c066e1770"
Sep 16 21:49:12.952514 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:12.952393    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhg7b" podUID="0c33c4f3-f43e-4a25-8c11-8390eeb45f12"
Sep 16 21:49:14.070669 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.070641    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-128.ec2.internal" event="NodeReady"
Sep 16 21:49:14.071151 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.070774    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 21:49:14.104536 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.104503    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"]
Sep 16 21:49:14.116938 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.116909    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b7d57c76b-7t8t6"]
Sep 16 21:49:14.117102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.117034    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.119903 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.119876    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 21:49:14.120037 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.119924    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 21:49:14.120158 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.120143    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2nrmg\""
Sep 16 21:49:14.130261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.129973    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"]
Sep 16 21:49:14.130261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.130070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.133098 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.133078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9dzlw\""
Sep 16 21:49:14.133405 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.133388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 21:49:14.133501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.133408    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 21:49:14.133501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.133447    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 21:49:14.139437 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.139416    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 21:49:14.151397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.151376    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"]
Sep 16 21:49:14.151520 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.151489    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.154281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.154122    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 21:49:14.154281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.154157    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 21:49:14.154281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.154224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 21:49:14.154281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.154157    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 21:49:14.154498 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.154341    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-96zms\""
Sep 16 21:49:14.173622 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.173546    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"]
Sep 16 21:49:14.173747 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.173682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.176431 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.176410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 21:49:14.188781 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.188760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"]
Sep 16 21:49:14.188882 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.188803    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ckn8r"]
Sep 16 21:49:14.188961 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.188880    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.191341 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.191320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 21:49:14.191456 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.191388    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 21:49:14.191580 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.191558    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 21:49:14.198722 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.198705    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 21:49:14.200848 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.200829    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-56lvz"]
Sep 16 21:49:14.201005 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.200989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.204071 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.203960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\""
Sep 16 21:49:14.204071 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.204021    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 21:49:14.204071 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.204043    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 21:49:14.216943 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.216922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"]
Sep 16 21:49:14.216943 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.216952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"]
Sep 16 21:49:14.217109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.216974    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b7d57c76b-7t8t6"]
Sep 16 21:49:14.217109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.216993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"]
Sep 16 21:49:14.217109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.217013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56lvz"]
Sep 16 21:49:14.217109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.217036    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckn8r"]
Sep 16 21:49:14.217109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.217041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.219516 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.219491    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 21:49:14.219626 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.219567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7xfr\""
Sep 16 21:49:14.219626 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.219588    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 21:49:14.219756 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.219692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 21:49:14.277037 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277194 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277194 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgmm4\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277285 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277232    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd041df0-0e13-463c-92de-45cde486e483-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.277285 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.277366 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e38d80f6-8188-444b-87d8-12400e878beb-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.277366 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xp69\" (UniqueName: \"kubernetes.io/projected/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-kube-api-access-9xp69\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.277366 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277361    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.277508 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277508 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.277508 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277508 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.277702 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa88c437-9d24-409e-9833-2689f795683b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.277702 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277702 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-tmp\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.277702 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836f2c51-421f-4e35-a71a-52285c687c0d-tmp-dir\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.277853 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.277853 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.277853 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p244g\" (UniqueName: \"kubernetes.io/projected/836f2c51-421f-4e35-a71a-52285c687c0d-kube-api-access-p244g\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.277853 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.277853 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.278024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.278024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx5qk\" (UniqueName: \"kubernetes.io/projected/fa88c437-9d24-409e-9833-2689f795683b-kube-api-access-vx5qk\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.278024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9897b\" (UniqueName: \"kubernetes.io/projected/bd041df0-0e13-463c-92de-45cde486e483-kube-api-access-9897b\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.278024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.277954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836f2c51-421f-4e35-a71a-52285c687c0d-config-volume\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.378580 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e38d80f6-8188-444b-87d8-12400e878beb-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.378580 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xp69\" (UniqueName: \"kubernetes.io/projected/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-kube-api-access-9xp69\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378642    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378665    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa88c437-9d24-409e-9833-2689f795683b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-tmp\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.378840 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2843ebf3-37d7-4a8b-beff-25d3806f27dd-cert\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836f2c51-421f-4e35-a71a-52285c687c0d-tmp-dir\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.378881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8x8\" (UniqueName: \"kubernetes.io/projected/2843ebf3-37d7-4a8b-beff-25d3806f27dd-kube-api-access-hp8x8\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p244g\" (UniqueName: \"kubernetes.io/projected/836f2c51-421f-4e35-a71a-52285c687c0d-kube-api-access-p244g\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx5qk\" (UniqueName: \"kubernetes.io/projected/fa88c437-9d24-409e-9833-2689f795683b-kube-api-access-vx5qk\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379241    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9897b\" (UniqueName: \"kubernetes.io/projected/bd041df0-0e13-463c-92de-45cde486e483-kube-api-access-9897b\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836f2c51-421f-4e35-a71a-52285c687c0d-config-volume\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-tmp\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379320    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.879298643 +0000 UTC m=+34.555487113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.379402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgmm4\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd041df0-0e13-463c-92de-45cde486e483-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379463    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379571    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379585    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.379838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/836f2c51-421f-4e35-a71a-52285c687c0d-config-volume\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379909    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.379958    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.879941992 +0000 UTC m=+34.556130464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:14.380160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.380005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e38d80f6-8188-444b-87d8-12400e878beb-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.380641 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.380211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/836f2c51-421f-4e35-a71a-52285c687c0d-tmp-dir\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.380641 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.380304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.380641 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.380410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa88c437-9d24-409e-9833-2689f795683b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.381197 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.381174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.381932 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.381916    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:14.881897662 +0000 UTC m=+34.558086130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:14.384193 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.384193 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.384342 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.384410 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-ca\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.384460 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-klusterlet-config\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.384542 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-hub\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.384896 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.384879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fa88c437-9d24-409e-9833-2689f795683b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.385515 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.385492    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd041df0-0e13-463c-92de-45cde486e483-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.389941 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.389909    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.390242 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.390217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xp69\" (UniqueName: \"kubernetes.io/projected/ae387313-1ae2-4e8a-ba42-8a3b11bccd9d-kube-api-access-9xp69\") pod \"klusterlet-addon-workmgr-8548d9675-zc687\" (UID: \"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.390818 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.390798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgmm4\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.391194 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.391177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9897b\" (UniqueName: \"kubernetes.io/projected/bd041df0-0e13-463c-92de-45cde486e483-kube-api-access-9897b\") pod \"managed-serviceaccount-addon-agent-6c89785d6b-xphvh\" (UID: \"bd041df0-0e13-463c-92de-45cde486e483\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.391254 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.391222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p244g\" (UniqueName: \"kubernetes.io/projected/836f2c51-421f-4e35-a71a-52285c687c0d-kube-api-access-p244g\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.391486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.391467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx5qk\" (UniqueName: \"kubernetes.io/projected/fa88c437-9d24-409e-9833-2689f795683b-kube-api-access-vx5qk\") pod \"cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8\" (UID: \"fa88c437-9d24-409e-9833-2689f795683b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.434168 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.434094    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:14.475999 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.475964    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:49:14.480344 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.480319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2843ebf3-37d7-4a8b-beff-25d3806f27dd-cert\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.480469 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.480356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8x8\" (UniqueName: \"kubernetes.io/projected/2843ebf3-37d7-4a8b-beff-25d3806f27dd-kube-api-access-hp8x8\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.480469 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.480383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:14.480566 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.480517    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:14.480640 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.480587    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.480569744 +0000 UTC m=+66.156758215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 21:49:14.483290 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.483269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2843ebf3-37d7-4a8b-beff-25d3806f27dd-cert\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.483409 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.483387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:14.491093 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.491071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8x8\" (UniqueName: \"kubernetes.io/projected/2843ebf3-37d7-4a8b-beff-25d3806f27dd-kube-api-access-hp8x8\") pod \"ingress-canary-56lvz\" (UID: \"2843ebf3-37d7-4a8b-beff-25d3806f27dd\") " pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.497745 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.497713    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:49:14.512157 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.512127    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:14.533260 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.533218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-56lvz"
Sep 16 21:49:14.583990 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.583734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:14.583990 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.583939    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:14.584860 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.584427    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret podName:c43b2736-e9b7-4461-97fe-c42c066e1770 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.584400191 +0000 UTC m=+66.260588660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret") pod "global-pull-secret-syncer-g8bwq" (UID: "c43b2736-e9b7-4461-97fe-c42c066e1770") : object "kube-system"/"original-pull-secret" not registered
Sep 16 21:49:14.684494 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.684412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:14.684662 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.684570    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 21:49:14.684662 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.684593    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 21:49:14.684662 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.684601    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9sns7 for pod openshift-network-diagnostics/network-check-target-nhg7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:14.684772 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.684667    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7 podName:0c33c4f3-f43e-4a25-8c11-8390eeb45f12 nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.684653822 +0000 UTC m=+66.360842291 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9sns7" (UniqueName: "kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7") pod "network-check-target-nhg7b" (UID: "0c33c4f3-f43e-4a25-8c11-8390eeb45f12") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 21:49:14.787345 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.787315    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"]
Sep 16 21:49:14.790787 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.790700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"]
Sep 16 21:49:14.791821 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.791802    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"]
Sep 16 21:49:14.793207 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:14.793140    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd041df0_0e13_463c_92de_45cde486e483.slice/crio-6987e3344fd1d377760b0aee0d3a0e48e347ae3dd12796db8d5584f803b29d03 WatchSource:0}: Error finding container 6987e3344fd1d377760b0aee0d3a0e48e347ae3dd12796db8d5584f803b29d03: Status 404 returned error can't find the container with id 6987e3344fd1d377760b0aee0d3a0e48e347ae3dd12796db8d5584f803b29d03
Sep 16 21:49:14.794518 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:14.794496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa88c437_9d24_409e_9833_2689f795683b.slice/crio-fde74f7f9ba5d22e1f351c044c7cb44c7dd7e8d934614b2edebd44e73400681a WatchSource:0}: Error finding container fde74f7f9ba5d22e1f351c044c7cb44c7dd7e8d934614b2edebd44e73400681a: Status 404 returned error can't find the container with id fde74f7f9ba5d22e1f351c044c7cb44c7dd7e8d934614b2edebd44e73400681a
Sep 16 21:49:14.795396 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:14.795375    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae387313_1ae2_4e8a_ba42_8a3b11bccd9d.slice/crio-e5d98d32cf776d6840034001da83212b9846b1431c7ecf65ca04c43731f033d2 WatchSource:0}: Error finding container e5d98d32cf776d6840034001da83212b9846b1431c7ecf65ca04c43731f033d2: Status 404 returned error can't find the container with id e5d98d32cf776d6840034001da83212b9846b1431c7ecf65ca04c43731f033d2
Sep 16 21:49:14.817461 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.817438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:14.823073 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.823046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-56lvz"]
Sep 16 21:49:14.825852 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:14.825833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2843ebf3_37d7_4a8b_beff_25d3806f27dd.slice/crio-3dabbad7420e88087c469d3cc9a1b20d9cda6d566776d8987357a8d71d8d76d0 WatchSource:0}: Error finding container 3dabbad7420e88087c469d3cc9a1b20d9cda6d566776d8987357a8d71d8d76d0: Status 404 returned error can't find the container with id 3dabbad7420e88087c469d3cc9a1b20d9cda6d566776d8987357a8d71d8d76d0
Sep 16 21:49:14.885402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.885338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:14.885402 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.885379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885498    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885502    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885521    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.885539    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885556    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.885539784 +0000 UTC m=+35.561728253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885587    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.885577835 +0000 UTC m=+35.561766298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885602    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:14.885709 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:14.885653    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:15.885641251 +0000 UTC m=+35.561829722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:14.917551 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.917521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:14.952733 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.952541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:14.952733 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.952541    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:14.952733 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.952555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\""
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955645    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955649    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 21:49:14.955764 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:14.955628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\""
Sep 16 21:49:15.100223 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.100176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56lvz" event={"ID":"2843ebf3-37d7-4a8b-beff-25d3806f27dd","Type":"ContainerStarted","Data":"3dabbad7420e88087c469d3cc9a1b20d9cda6d566776d8987357a8d71d8d76d0"}
Sep 16 21:49:15.101519 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.101488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerStarted","Data":"fde74f7f9ba5d22e1f351c044c7cb44c7dd7e8d934614b2edebd44e73400681a"}
Sep 16 21:49:15.102824 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.102760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerStarted","Data":"e5d98d32cf776d6840034001da83212b9846b1431c7ecf65ca04c43731f033d2"}
Sep 16 21:49:15.104076 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.104047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerStarted","Data":"6987e3344fd1d377760b0aee0d3a0e48e347ae3dd12796db8d5584f803b29d03"}
Sep 16 21:49:15.893911 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.893869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:15.894113 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.893927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:15.894113 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:15.894015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:15.894113 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894052    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:15.894113 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894077    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:15.894306 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894144    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.894122989 +0000 UTC m=+37.570311468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:15.894306 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894146    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:15.894306 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894208    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.894192226 +0000 UTC m=+37.570380685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:15.894306 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894268    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:15.894306 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:15.894298    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:17.89428769 +0000 UTC m=+37.570476149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:17.916280 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:17.916237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:17.916290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:17.916372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916397    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916419    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916471    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916478    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.916463625 +0000 UTC m=+41.592652091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916485    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916519    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.916506612 +0000 UTC m=+41.592695083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:17.916925 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:17.916535    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:21.916527516 +0000 UTC m=+41.592716011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:19.166435 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:19.166345    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:19.228033 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:19.227985    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:19.381094 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:19.381026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:19.480854 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:19.480821    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log" limit=1024
Sep 16 21:49:21.952503 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:21.952455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:21.952503 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:21.952500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:21.952561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952633    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952657    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952698    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952726    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.952705239 +0000 UTC m=+49.628893711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952736    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952744    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.952732559 +0000 UTC m=+49.628921029 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:21.953105 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:21.952826    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:29.952810498 +0000 UTC m=+49.628998969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:25.135138 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.135098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-56lvz" event={"ID":"2843ebf3-37d7-4a8b-beff-25d3806f27dd","Type":"ContainerStarted","Data":"af60f3b0a8d4c3f87164666f05ff951b664fc2fdbd37addbf9c11b44593ae8a9"}
Sep 16 21:49:25.137160 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.137136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerStarted","Data":"2c7e8e346dbc275af69b77ac7a0c7de5ed13aba5a53b1f580bcf17f88553ece0"}
Sep 16 21:49:25.137284 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.137170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerStarted","Data":"f1d06d28c3ad70d24a38f9164505f744ef17059cf61d5731e13c11900b78251f"}
Sep 16 21:49:25.137284 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.137185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerStarted","Data":"54aa5d64689d6fd0a6e8ba0d12ba95cc4c45fe79b254514074bffbf5dd2bffa4"}
Sep 16 21:49:25.138744 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.138721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerStarted","Data":"1bd67f54dd7cc73e10d7fa9750c76f1806056ddd49d7c4349ec2b28445077f91"}
Sep 16 21:49:25.138891 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.138873    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:25.140316 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.140287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerStarted","Data":"765167e14e6cee8d7092ab9a1aaa220383e803613b4f1005be9b66f79a459a8c"}
Sep 16 21:49:25.140774 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.140759    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:49:25.142966 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.142941    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="fda6b979493136022e0803e823a4edb577ed61769bd3797f78cf1c5be639ba95" exitCode=0
Sep 16 21:49:25.143041 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.142980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"fda6b979493136022e0803e823a4edb577ed61769bd3797f78cf1c5be639ba95"}
Sep 16 21:49:25.149966 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.149834    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-56lvz" podStartSLOduration=1.7934596699999998 podStartE2EDuration="11.149817851s" totalImagesPullingTime="9.356358181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.149064958 +0000 UTC m=+44.825253428" watchObservedRunningTime="2026-09-16 21:49:25.149817851 +0000 UTC m=+44.826006330"
Sep 16 21:49:25.185653 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.185555    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" podStartSLOduration=2.796197538 podStartE2EDuration="12.185534285s" totalImagesPullingTime="9.389336747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.168487294 +0000 UTC m=+44.844675774" watchObservedRunningTime="2026-09-16 21:49:25.185534285 +0000 UTC m=+44.861722767"
Sep 16 21:49:25.186337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.186292    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" podStartSLOduration=2.798487242 podStartE2EDuration="12.186281104s" totalImagesPullingTime="9.387793862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.184776589 +0000 UTC m=+44.860965068" watchObservedRunningTime="2026-09-16 21:49:25.186281104 +0000 UTC m=+44.862469583"
Sep 16 21:49:25.199152 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:25.199093    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" podStartSLOduration=2.3539468550000002 podStartE2EDuration="12.199074829s" totalImagesPullingTime="9.845127974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:25.19893544 +0000 UTC m=+44.875123918" watchObservedRunningTime="2026-09-16 21:49:25.199074829 +0000 UTC m=+44.875263305"
Sep 16 21:49:26.148882 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:26.148845    2580 generic.go:356] "Generic (PLEG): container finished" podID="b63a5289-64ed-4b53-b249-a72818c21dfc" containerID="547095193e8cab2e02868c2e1f250f65a454794a1955dfc3fe8f0cd718d74bbe" exitCode=0
Sep 16 21:49:26.149262 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:26.148940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerDied","Data":"547095193e8cab2e02868c2e1f250f65a454794a1955dfc3fe8f0cd718d74bbe"}
Sep 16 21:49:27.156209 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:27.156167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" event={"ID":"b63a5289-64ed-4b53-b249-a72818c21dfc","Type":"ContainerStarted","Data":"54ac78cc0c31124deaea2860eba476b9a094b857b28b0b0e860abf5cdfb97040"}
Sep 16 21:49:27.183364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:27.180574    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mbcb6" podStartSLOduration=8.80914723 podStartE2EDuration="46.180512662s" totalImagesPullingTime="37.371365432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:27.179508857 +0000 UTC m=+46.855697334" watchObservedRunningTime="2026-09-16 21:49:27.180512662 +0000 UTC m=+46.856701141"
Sep 16 21:49:30.013541 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:30.013501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:30.013541 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:30.013544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:30.013626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013667    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013688    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013736    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013746    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.013731218 +0000 UTC m=+65.689919678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013782    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.01377081 +0000 UTC m=+65.689959266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013736    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:30.013977 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:30.013811    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:49:46.013802311 +0000 UTC m=+65.689990768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:39.089696 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:39.089665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k8n4z"
Sep 16 21:49:46.039383 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.039334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.039430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039490    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039556    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:50:18.039538857 +0000 UTC m=+97.715727318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039562    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039573    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039589    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.039490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039640    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:50:18.039626377 +0000 UTC m=+97.715814849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:49:46.039961 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.039680    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:50:18.039656125 +0000 UTC m=+97.715844584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:49:46.542873 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.542822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:49:46.545261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.545244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 21:49:46.553235 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.553214    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:49:46.553295 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:49:46.553285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:50:50.55326189 +0000 UTC m=+130.229450353 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : secret "metrics-daemon-secret" not found
Sep 16 21:49:46.643515 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.643469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:46.646016 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.645992    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 21:49:46.656549 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.656519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c43b2736-e9b7-4461-97fe-c42c066e1770-original-pull-secret\") pod \"global-pull-secret-syncer-g8bwq\" (UID: \"c43b2736-e9b7-4461-97fe-c42c066e1770\") " pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:46.744844 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.744794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:46.747637 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.747597    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 21:49:46.757992 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.757974    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 21:49:46.768427 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.768395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sns7\" (UniqueName: \"kubernetes.io/projected/0c33c4f3-f43e-4a25-8c11-8390eeb45f12-kube-api-access-9sns7\") pod \"network-check-target-nhg7b\" (UID: \"0c33c4f3-f43e-4a25-8c11-8390eeb45f12\") " pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:46.778343 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.778321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pd2w2\""
Sep 16 21:49:46.782290 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.782276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g8bwq"
Sep 16 21:49:46.786405 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:46.786385    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:47.056187 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:47.056163    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g8bwq"]
Sep 16 21:49:47.058893 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:47.058736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43b2736_e9b7_4461_97fe_c42c066e1770.slice/crio-5efdf1f255be3fd4c4fff9b8b28f2f54e67d87bcb9cf4865ae5e695ab82be8bc WatchSource:0}: Error finding container 5efdf1f255be3fd4c4fff9b8b28f2f54e67d87bcb9cf4865ae5e695ab82be8bc: Status 404 returned error can't find the container with id 5efdf1f255be3fd4c4fff9b8b28f2f54e67d87bcb9cf4865ae5e695ab82be8bc
Sep 16 21:49:47.059233 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:47.059208    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhg7b"]
Sep 16 21:49:47.061266 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:49:47.061247    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c33c4f3_f43e_4a25_8c11_8390eeb45f12.slice/crio-0901fb48c0af87806c7729c891bceea9631a8815f0fadba57682131d04854653 WatchSource:0}: Error finding container 0901fb48c0af87806c7729c891bceea9631a8815f0fadba57682131d04854653: Status 404 returned error can't find the container with id 0901fb48c0af87806c7729c891bceea9631a8815f0fadba57682131d04854653
Sep 16 21:49:47.219880 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:47.219845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhg7b" event={"ID":"0c33c4f3-f43e-4a25-8c11-8390eeb45f12","Type":"ContainerStarted","Data":"0901fb48c0af87806c7729c891bceea9631a8815f0fadba57682131d04854653"}
Sep 16 21:49:47.221002 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:47.220978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8bwq" event={"ID":"c43b2736-e9b7-4461-97fe-c42c066e1770","Type":"ContainerStarted","Data":"5efdf1f255be3fd4c4fff9b8b28f2f54e67d87bcb9cf4865ae5e695ab82be8bc"}
Sep 16 21:49:52.241744 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:52.241704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhg7b" event={"ID":"0c33c4f3-f43e-4a25-8c11-8390eeb45f12","Type":"ContainerStarted","Data":"177a02b6e79a3e46c786fb72f906abb9ff2c5e3b6ca13d1149f4a0ebd4046afd"}
Sep 16 21:49:52.242218 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:52.241842    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:49:52.243387 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:52.243360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g8bwq" event={"ID":"c43b2736-e9b7-4461-97fe-c42c066e1770","Type":"ContainerStarted","Data":"1a0797d6941ae725360d660aae234c8c149e701162f91df1a1f46d6679b36f85"}
Sep 16 21:49:52.255977 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:52.255920    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nhg7b" podStartSLOduration=66.293301595 podStartE2EDuration="1m11.255907121s" totalImagesPullingTime="4.962605526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:52.254705847 +0000 UTC m=+71.930894324" watchObservedRunningTime="2026-09-16 21:49:52.255907121 +0000 UTC m=+71.932095598"
Sep 16 21:49:52.267822 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:49:52.267764    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g8bwq" podStartSLOduration=66.298070604 podStartE2EDuration="1m11.267747911s" totalImagesPullingTime="4.969677307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:49:52.2672284 +0000 UTC m=+71.943416878" watchObservedRunningTime="2026-09-16 21:49:52.267747911 +0000 UTC m=+71.943936388"
Sep 16 21:50:18.080091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:50:18.079952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:50:18.080091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:50:18.080001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:50:18.080091 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:50:18.080048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080121    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080144    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080151    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080146    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080214    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:51:22.080194269 +0000 UTC m=+161.756382740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080230    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:51:22.080222488 +0000 UTC m=+161.756410944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:50:18.080644 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:18.080242    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:51:22.080235091 +0000 UTC m=+161.756423548 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:50:23.249039 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:50:23.249011    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nhg7b"
Sep 16 21:50:50.617750 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:50:50.617696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:50:50.618259 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:50.617865    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:50:50.618259 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:50:50.617937    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:52:52.617921926 +0000 UTC m=+252.294110385 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : secret "metrics-daemon-secret" not found
Sep 16 21:51:17.132493 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:17.132442    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" podUID="e38d80f6-8188-444b-87d8-12400e878beb"
Sep 16 21:51:17.140788 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:17.140750    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6" podUID="c3c49445-8189-421f-99e8-5ed225faff7f"
Sep 16 21:51:17.228410 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:17.228359    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ckn8r" podUID="836f2c51-421f-4e35-a71a-52285c687c0d"
Sep 16 21:51:17.490645 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:17.490590    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:51:17.490645 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:17.490621    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:51:17.490896 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:17.490783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:51:17.969062 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:17.968967    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:51:22.153751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:22.153707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:51:22.153751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:22.153746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:22.153787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153846    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153865    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153864    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153915    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153918    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:53:24.153902732 +0000 UTC m=+283.830091192 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.153995    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:53:24.153978968 +0000 UTC m=+283.830167426 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:51:22.154181 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:51:22.154010    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:53:24.154001484 +0000 UTC m=+283.830189943 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:51:24.476847 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:24.476794    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" podUID="bd041df0-0e13-463c-92de-45cde486e483" containerName="addon-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/healthz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Sep 16 21:51:24.514314 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:24.514277    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd041df0-0e13-463c-92de-45cde486e483" containerID="765167e14e6cee8d7092ab9a1aaa220383e803613b4f1005be9b66f79a459a8c" exitCode=255
Sep 16 21:51:24.514486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:24.514347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerDied","Data":"765167e14e6cee8d7092ab9a1aaa220383e803613b4f1005be9b66f79a459a8c"}
Sep 16 21:51:24.514664 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:24.514651    2580 scope.go:117] "RemoveContainer" containerID="765167e14e6cee8d7092ab9a1aaa220383e803613b4f1005be9b66f79a459a8c"
Sep 16 21:51:25.139648 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:25.139544    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" podUID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
Sep 16 21:51:25.518464 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:25.518434    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d" containerID="1bd67f54dd7cc73e10d7fa9750c76f1806056ddd49d7c4349ec2b28445077f91" exitCode=1
Sep 16 21:51:25.518936 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:25.518516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerDied","Data":"1bd67f54dd7cc73e10d7fa9750c76f1806056ddd49d7c4349ec2b28445077f91"}
Sep 16 21:51:25.518936 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:25.518866    2580 scope.go:117] "RemoveContainer" containerID="1bd67f54dd7cc73e10d7fa9750c76f1806056ddd49d7c4349ec2b28445077f91"
Sep 16 21:51:25.520347 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:25.520324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerStarted","Data":"55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f"}
Sep 16 21:51:26.525450 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:26.525419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerStarted","Data":"b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"}
Sep 16 21:51:26.525841 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:26.525736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:51:26.526338 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:26.526319    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:51:29.952796 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:51:29.952744    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:52:52.621618 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:52:52.621551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:52:52.622092 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:52:52.621723    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 21:52:52.622092 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:52:52.621795    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs podName:82bad579-3540-4c3e-af21-67edf91dbf8d nodeName:}" failed. No retries permitted until 2026-09-16 21:54:54.621779367 +0000 UTC m=+374.297967846 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs") pod "network-metrics-daemon-h9wtn" (UID: "82bad579-3540-4c3e-af21-67edf91dbf8d") : secret "metrics-daemon-secret" not found
Sep 16 21:53:18.030033 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.029952    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vms"]
Sep 16 21:53:18.032862 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.032845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.035450 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.035427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 21:53:18.035561 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.035434    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 21:53:18.035561 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.035470    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 21:53:18.035561 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.035470    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 21:53:18.036633 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.036598    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pbdm9\""
Sep 16 21:53:18.043057 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.043038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vms"]
Sep 16 21:53:18.103540 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.103505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-data-volume\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.103729 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.103563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.103729 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.103643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-crio-socket\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.103729 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.103664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz224\" (UniqueName: \"kubernetes.io/projected/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-api-access-xz224\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.103729 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.103691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204759 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-crio-socket\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz224\" (UniqueName: \"kubernetes.io/projected/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-api-access-xz224\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204881    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-crio-socket\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.204894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-data-volume\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.204927 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.204857    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.205182 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.204995    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.205182 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.205008    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.704988861 +0000 UTC m=+278.381177317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.205182 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.205064    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:18.705047569 +0000 UTC m=+278.381236046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.205283 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.205182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-data-volume\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.212801 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.212773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz224\" (UniqueName: \"kubernetes.io/projected/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-api-access-xz224\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.709890 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.709857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.710062 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.709981    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.710062 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:18.710006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:18.710062 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.710050    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.71003005 +0000 UTC m=+279.386218520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:18.710186 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.710092    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:18.710186 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:18.710149    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:19.71013804 +0000 UTC m=+279.386326501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:19.717113 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:19.717078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:19.717488 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:19.717163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:19.717488 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:19.717203    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:19.717488 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:19.717267    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.7172535 +0000 UTC m=+281.393441961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:19.717488 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:19.717313    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:19.717488 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:19.717368    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:21.717354867 +0000 UTC m=+281.393543340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:20.491946 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:20.491862    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ckn8r" podUID="836f2c51-421f-4e35-a71a-52285c687c0d"
Sep 16 21:53:20.491946 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:20.491895    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6" podUID="c3c49445-8189-421f-99e8-5ed225faff7f"
Sep 16 21:53:20.491946 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:20.491895    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" podUID="e38d80f6-8188-444b-87d8-12400e878beb"
Sep 16 21:53:20.810146 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:20.810073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd2w7_faed1203-1b10-4f5b-bfbd-83eaaaa218e8/dns-node-resolver/0.log"
Sep 16 21:53:20.850149 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:20.850124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:53:20.850265 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:20.850126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:53:20.850301 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:20.850129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:53:21.732425 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:21.732384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:21.732653 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:21.732487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:21.732653 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:21.732514    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:21.732653 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:21.732579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.732562721 +0000 UTC m=+285.408751179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:21.732653 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:21.732645    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:21.732828 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:21.732708    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:25.732695138 +0000 UTC m=+285.408883612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:21.804174 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:21.804148    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhjbv_295d2cae-f99d-4964-aa75-622967559cfb/node-ca/0.log"
Sep 16 21:53:22.403079 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:22.403052    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56lvz_2843ebf3-37d7-4a8b-beff-25d3806f27dd/serve-healthcheck-canary/0.log"
Sep 16 21:53:24.254330 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.254281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") pod \"image-registry-7b7d57c76b-7t8t6\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") " pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:53:24.254330 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.254346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.254379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254435    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254458    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b7d57c76b-7t8t6: secret "image-registry-tls" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254481    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254483    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254537    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls podName:c3c49445-8189-421f-99e8-5ed225faff7f nodeName:}" failed. No retries permitted until 2026-09-16 21:55:26.254518057 +0000 UTC m=+405.930706534 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls") pod "image-registry-7b7d57c76b-7t8t6" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f") : secret "image-registry-tls" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254556    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert podName:e38d80f6-8188-444b-87d8-12400e878beb nodeName:}" failed. No retries permitted until 2026-09-16 21:55:26.254547143 +0000 UTC m=+405.930735600 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-jwtr7" (UID: "e38d80f6-8188-444b-87d8-12400e878beb") : secret "networking-console-plugin-cert" not found
Sep 16 21:53:24.254934 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.254573    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls podName:836f2c51-421f-4e35-a71a-52285c687c0d nodeName:}" failed. No retries permitted until 2026-09-16 21:55:26.254564844 +0000 UTC m=+405.930753336 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls") pod "dns-default-ckn8r" (UID: "836f2c51-421f-4e35-a71a-52285c687c0d") : secret "dns-default-metrics-tls" not found
Sep 16 21:53:24.863393 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.863362    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd041df0-0e13-463c-92de-45cde486e483" containerID="55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f" exitCode=255
Sep 16 21:53:24.863583 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.863444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerDied","Data":"55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f"}
Sep 16 21:53:24.863583 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.863500    2580 scope.go:117] "RemoveContainer" containerID="765167e14e6cee8d7092ab9a1aaa220383e803613b4f1005be9b66f79a459a8c"
Sep 16 21:53:24.863832 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:24.863779    2580 scope.go:117] "RemoveContainer" containerID="55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f"
Sep 16 21:53:24.864004 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:24.863983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6c89785d6b-xphvh_open-cluster-management-agent-addon(bd041df0-0e13-463c-92de-45cde486e483)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" podUID="bd041df0-0e13-463c-92de-45cde486e483"
Sep 16 21:53:25.767870 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.767818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:25.768294 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:25.767912    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 21:53:25.768294 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:25.767979    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.767963662 +0000 UTC m=+293.444152153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : configmap "kube-rbac-proxy" not found
Sep 16 21:53:25.768294 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.767921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:25.768294 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:25.767992    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:25.768294 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:25.768052    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls podName:a5292d06-2da9-4fc2-a2e2-16a8c0d228c4 nodeName:}" failed. No retries permitted until 2026-09-16 21:53:33.768038599 +0000 UTC m=+293.444227058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5vms" (UID: "a5292d06-2da9-4fc2-a2e2-16a8c0d228c4") : secret "insights-runtime-extractor-tls" not found
Sep 16 21:53:25.868254 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.868167    2580 generic.go:356] "Generic (PLEG): container finished" podID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d" containerID="b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84" exitCode=1
Sep 16 21:53:25.868404 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.868247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerDied","Data":"b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"}
Sep 16 21:53:25.868404 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.868315    2580 scope.go:117] "RemoveContainer" containerID="1bd67f54dd7cc73e10d7fa9750c76f1806056ddd49d7c4349ec2b28445077f91"
Sep 16 21:53:25.868656 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:25.868623    2580 scope.go:117] "RemoveContainer" containerID="b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"
Sep 16 21:53:25.868828 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:25.868809    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8548d9675-zc687_open-cluster-management-agent-addon(ae387313-1ae2-4e8a-ba42-8a3b11bccd9d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" podUID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d"
Sep 16 21:53:26.526501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:26.526458    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:53:26.874004 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:26.873924    2580 scope.go:117] "RemoveContainer" containerID="b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"
Sep 16 21:53:26.874455 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:26.874106    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8548d9675-zc687_open-cluster-management-agent-addon(ae387313-1ae2-4e8a-ba42-8a3b11bccd9d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" podUID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d"
Sep 16 21:53:32.954013 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:32.953979    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h9wtn" podUID="82bad579-3540-4c3e-af21-67edf91dbf8d"
Sep 16 21:53:33.831937 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:33.831886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:33.832108 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:33.831965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:33.832396 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:33.832381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:33.834179 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:33.834159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5292d06-2da9-4fc2-a2e2-16a8c0d228c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5vms\" (UID: \"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4\") " pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:33.942261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:33.942228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5vms"
Sep 16 21:53:34.208773 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.208700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5vms"]
Sep 16 21:53:34.213126 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:53:34.213086    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5292d06_2da9_4fc2_a2e2_16a8c0d228c4.slice/crio-dbec622b2836988aa406252e48aee005c5b559872cb03a3b02ecb421a4217d1b WatchSource:0}: Error finding container dbec622b2836988aa406252e48aee005c5b559872cb03a3b02ecb421a4217d1b: Status 404 returned error can't find the container with id dbec622b2836988aa406252e48aee005c5b559872cb03a3b02ecb421a4217d1b
Sep 16 21:53:34.476202 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.476110    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh"
Sep 16 21:53:34.476473 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.476443    2580 scope.go:117] "RemoveContainer" containerID="55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f"
Sep 16 21:53:34.476667 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:34.476645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6c89785d6b-xphvh_open-cluster-management-agent-addon(bd041df0-0e13-463c-92de-45cde486e483)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" podUID="bd041df0-0e13-463c-92de-45cde486e483"
Sep 16 21:53:34.484124 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.484105    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:53:34.484405 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.484393    2580 scope.go:117] "RemoveContainer" containerID="b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"
Sep 16 21:53:34.484525 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:53:34.484509    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-8548d9675-zc687_open-cluster-management-agent-addon(ae387313-1ae2-4e8a-ba42-8a3b11bccd9d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" podUID="ae387313-1ae2-4e8a-ba42-8a3b11bccd9d"
Sep 16 21:53:34.897520 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.897471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vms" event={"ID":"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4","Type":"ContainerStarted","Data":"24b9b697fc8949bf88b09e8fd80f9ad51b61cdb0b7b291e178ceccee5ad994df"}
Sep 16 21:53:34.897698 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:34.897538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vms" event={"ID":"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4","Type":"ContainerStarted","Data":"dbec622b2836988aa406252e48aee005c5b559872cb03a3b02ecb421a4217d1b"}
Sep 16 21:53:35.902601 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:35.902564    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vms" event={"ID":"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4","Type":"ContainerStarted","Data":"4b64aed8a709690d7c5d395522a13f5ab9927071bbf541bf2ea95d14f657887b"}
Sep 16 21:53:36.908272 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:36.908187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5vms" event={"ID":"a5292d06-2da9-4fc2-a2e2-16a8c0d228c4","Type":"ContainerStarted","Data":"9a2c7b6fe06a601ec67fe7382f74da227f5f8a41771c3d2a20fb4086f2ba87f0"}
Sep 16 21:53:36.926838 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:36.926791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z5vms" podStartSLOduration=16.756220427 podStartE2EDuration="18.9267721s" totalImagesPullingTime="2.170551673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:36.925035388 +0000 UTC m=+296.601223868" watchObservedRunningTime="2026-09-16 21:53:36.9267721 +0000 UTC m=+296.602960579"
Sep 16 21:53:40.723888 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:40.723854    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 21:53:45.952181 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:45.952143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:53:45.954545 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:45.952550    2580 scope.go:117] "RemoveContainer" containerID="b10b183bb4fada5cf43969b338a4988143c51af58f635d63c53968c5cc0a1a84"
Sep 16 21:53:46.940497 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:46.940463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687" event={"ID":"ae387313-1ae2-4e8a-ba42-8a3b11bccd9d","Type":"ContainerStarted","Data":"176d2e8804e82238735e800744943af98185b0e5202ee9cd5b65607043699dda"}
Sep 16 21:53:46.940796 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:46.940778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:53:46.942358 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:46.942338    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8548d9675-zc687"
Sep 16 21:53:49.953351 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:49.953321    2580 scope.go:117] "RemoveContainer" containerID="55d3cf53196600d6c7a1bd941a24067abce610ea1eda86ae3140279ef731c18f"
Sep 16 21:53:50.955109 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:50.955078    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c89785d6b-xphvh" event={"ID":"bd041df0-0e13-463c-92de-45cde486e483","Type":"ContainerStarted","Data":"499f7f79a2fc546c9ac6708c05761c5949e14d916498df17d11db34fae4d0e20"}
Sep 16 21:53:55.863964 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.861449    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xxgvs"]
Sep 16 21:53:55.866112 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.866093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.868825 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.868804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 21:53:55.868949 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.868909    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 21:53:55.869235 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.869218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 21:53:55.870126 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.870102    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 21:53:55.870214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.870134    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 21:53:55.870261 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.870241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 21:53:55.870397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.870381    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lrmkc\""
Sep 16 21:53:55.988685 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.988685 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclqr\" (UniqueName: \"kubernetes.io/projected/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-kube-api-access-dclqr\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-wtmp\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-root\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-metrics-client-ca\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-tls\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-sys\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:55.989006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:55.988979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-textfile\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090049 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-root\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-metrics-client-ca\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-tls\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-sys\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-root\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090214 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-textfile\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090479 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090479 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-sys\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090479 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclqr\" (UniqueName: \"kubernetes.io/projected/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-kube-api-access-dclqr\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090479 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-wtmp\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090680 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-textfile\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090680 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-wtmp\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090743 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-metrics-client-ca\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.090848 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.090829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.092386 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.092370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.092501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.092485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-node-exporter-tls\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.098496 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.098474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclqr\" (UniqueName: \"kubernetes.io/projected/c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f-kube-api-access-dclqr\") pod \"node-exporter-xxgvs\" (UID: \"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f\") " pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.174726 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.174641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxgvs"
Sep 16 21:53:56.184774 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:53:56.184749    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ebbb3e_9c57_4a26_b24f_2d4df5a92c0f.slice/crio-ad65c7a58feb9dbc6109a211c8cc08ac293baf06ef1b2b1fc2943fa790fbc5bf WatchSource:0}: Error finding container ad65c7a58feb9dbc6109a211c8cc08ac293baf06ef1b2b1fc2943fa790fbc5bf: Status 404 returned error can't find the container with id ad65c7a58feb9dbc6109a211c8cc08ac293baf06ef1b2b1fc2943fa790fbc5bf
Sep 16 21:53:56.186454 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.186436    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:53:56.969886 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:56.969850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxgvs" event={"ID":"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f","Type":"ContainerStarted","Data":"ad65c7a58feb9dbc6109a211c8cc08ac293baf06ef1b2b1fc2943fa790fbc5bf"}
Sep 16 21:53:57.974524 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:57.974487    2580 generic.go:356] "Generic (PLEG): container finished" podID="c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f" containerID="107b020724c209a38c1fc7d7f85a6580292269bde2502a520d9b60ced9a03b5c" exitCode=0
Sep 16 21:53:57.974524 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:57.974528    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxgvs" event={"ID":"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f","Type":"ContainerDied","Data":"107b020724c209a38c1fc7d7f85a6580292269bde2502a520d9b60ced9a03b5c"}
Sep 16 21:53:58.979213 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:58.979176    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxgvs" event={"ID":"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f","Type":"ContainerStarted","Data":"5e2c6264d916ce70e38842be8f6ecda6735e20e893dbf20db1aed3fbb6146555"}
Sep 16 21:53:58.979654 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:58.979226    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxgvs" event={"ID":"c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f","Type":"ContainerStarted","Data":"d30e2f4ee554808c14eb4383889a134b131fc0a84839389ad6b9393c50e04c64"}
Sep 16 21:53:58.999404 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:53:58.999361    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xxgvs" podStartSLOduration=2.962364654 podStartE2EDuration="3.999346573s" totalImagesPullingTime="978.263878ms" totalInitContainerRuntime="58.718041ms" isStatefulPod=true podCreationTimestamp="2026-09-16 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:53:58.997416457 +0000 UTC m=+318.673604934" watchObservedRunningTime="2026-09-16 21:53:58.999346573 +0000 UTC m=+318.675535093"
Sep 16 21:54:02.817649 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:02.817593    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b7d57c76b-7t8t6"]
Sep 16 21:54:02.818078 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:54:02.817898    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6" podUID="c3c49445-8189-421f-99e8-5ed225faff7f"
Sep 16 21:54:02.990876 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:02.990845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:54:02.996934 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:02.996909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:54:03.040697 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.040830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040703    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.040830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.040830 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgmm4\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.040994 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.040994 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.040979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.041098 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.041027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets\") pod \"c3c49445-8189-421f-99e8-5ed225faff7f\" (UID: \"c3c49445-8189-421f-99e8-5ed225faff7f\") "
Sep 16 21:54:03.041163 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.041132    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:54:03.041254 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.041225    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:54:03.041363 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.041257    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-registry-certificates\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.041433 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.041362    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:54:03.043044 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.043020    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:54:03.043138 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.043035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:54:03.043368 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.043348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4" (OuterVolumeSpecName: "kube-api-access-bgmm4") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "kube-api-access-bgmm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:54:03.043368 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.043356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c3c49445-8189-421f-99e8-5ed225faff7f" (UID: "c3c49445-8189-421f-99e8-5ed225faff7f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142164    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-installation-pull-secrets\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142187    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3c49445-8189-421f-99e8-5ed225faff7f-image-registry-private-configuration\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142197    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-bound-sa-token\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142206    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgmm4\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-kube-api-access-bgmm4\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142216    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3c49445-8189-421f-99e8-5ed225faff7f-trusted-ca\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.142230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.142225    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3c49445-8189-421f-99e8-5ed225faff7f-ca-trust-extracted\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:03.994010 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:03.993978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b7d57c76b-7t8t6"
Sep 16 21:54:04.026700 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:04.026671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b7d57c76b-7t8t6"]
Sep 16 21:54:04.030464 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:04.030441    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b7d57c76b-7t8t6"]
Sep 16 21:54:04.149630 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:04.149583    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3c49445-8189-421f-99e8-5ed225faff7f-registry-tls\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:54:04.956739 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:04.956698    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3c49445-8189-421f-99e8-5ed225faff7f" path="/var/lib/kubelet/pods/c3c49445-8189-421f-99e8-5ed225faff7f/volumes"
Sep 16 21:54:24.499467 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:24.499422    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" podUID="fa88c437-9d24-409e-9833-2689f795683b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 21:54:34.499276 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:34.499198    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" podUID="fa88c437-9d24-409e-9833-2689f795683b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 21:54:44.499507 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:44.499465    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" podUID="fa88c437-9d24-409e-9833-2689f795683b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 21:54:44.499980 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:44.499545    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8"
Sep 16 21:54:44.500135 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:44.500105    2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2c7e8e346dbc275af69b77ac7a0c7de5ed13aba5a53b1f580bcf17f88553ece0"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 16 21:54:44.500172 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:44.500158    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" podUID="fa88c437-9d24-409e-9833-2689f795683b" containerName="service-proxy" containerID="cri-o://2c7e8e346dbc275af69b77ac7a0c7de5ed13aba5a53b1f580bcf17f88553ece0" gracePeriod=30
Sep 16 21:54:45.121747 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:45.121713    2580 generic.go:356] "Generic (PLEG): container finished" podID="fa88c437-9d24-409e-9833-2689f795683b" containerID="2c7e8e346dbc275af69b77ac7a0c7de5ed13aba5a53b1f580bcf17f88553ece0" exitCode=2
Sep 16 21:54:45.121747 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:45.121758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerDied","Data":"2c7e8e346dbc275af69b77ac7a0c7de5ed13aba5a53b1f580bcf17f88553ece0"}
Sep 16 21:54:45.121970 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:45.121791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d7cffcdbc-x4gp8" event={"ID":"fa88c437-9d24-409e-9833-2689f795683b","Type":"ContainerStarted","Data":"d3c7124aaaec3cd5969de2ca59a2f986ed74da27ee856cbb2dce436230fbfe37"}
Sep 16 21:54:46.166664 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:46.166635    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/init-textfile/0.log"
Sep 16 21:54:46.362225 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:46.362196    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/node-exporter/0.log"
Sep 16 21:54:46.561045 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:46.561023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/kube-rbac-proxy/0.log"
Sep 16 21:54:54.635051 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:54.635009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:54:54.637348 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:54.637318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82bad579-3540-4c3e-af21-67edf91dbf8d-metrics-certs\") pod \"network-metrics-daemon-h9wtn\" (UID: \"82bad579-3540-4c3e-af21-67edf91dbf8d\") " pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:54:54.656795 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:54.656760    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cplt\""
Sep 16 21:54:54.664380 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:54.664084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h9wtn"
Sep 16 21:54:54.949459 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:54.949435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h9wtn"]
Sep 16 21:54:54.951960 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:54:54.951894    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bad579_3540_4c3e_af21_67edf91dbf8d.slice/crio-a2efeabd747238623a11be1d7cfac448723e03fbb8174712422185097e114c34 WatchSource:0}: Error finding container a2efeabd747238623a11be1d7cfac448723e03fbb8174712422185097e114c34: Status 404 returned error can't find the container with id a2efeabd747238623a11be1d7cfac448723e03fbb8174712422185097e114c34
Sep 16 21:54:55.152162 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:55.152124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9wtn" event={"ID":"82bad579-3540-4c3e-af21-67edf91dbf8d","Type":"ContainerStarted","Data":"a2efeabd747238623a11be1d7cfac448723e03fbb8174712422185097e114c34"}
Sep 16 21:54:57.162163 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:57.162126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9wtn" event={"ID":"82bad579-3540-4c3e-af21-67edf91dbf8d","Type":"ContainerStarted","Data":"ff2f19b762bae4ddde45a936e96adc1a6f8c81b15b7b3020519984f0e7e0088f"}
Sep 16 21:54:57.162586 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:57.162183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h9wtn" event={"ID":"82bad579-3540-4c3e-af21-67edf91dbf8d","Type":"ContainerStarted","Data":"6250983c4c8710e1cd7142dce31e1592afcf3a1d61b9133ac2d1d5548819e851"}
Sep 16 21:54:57.179322 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:54:57.179269    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h9wtn" podStartSLOduration=375.059285654 podStartE2EDuration="6m16.179255095s" totalImagesPullingTime="1.119969441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:54:57.178098906 +0000 UTC m=+376.854287396" watchObservedRunningTime="2026-09-16 21:54:57.179255095 +0000 UTC m=+376.855443599"
Sep 16 21:55:23.851297 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:55:23.851259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" podUID="e38d80f6-8188-444b-87d8-12400e878beb"
Sep 16 21:55:23.851297 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:55:23.851262    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ckn8r" podUID="836f2c51-421f-4e35-a71a-52285c687c0d"
Sep 16 21:55:24.247400 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:24.247372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:55:24.247551 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:24.247372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:55:26.354559 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.354518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:55:26.354938 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.354574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:55:26.356952 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.356925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e38d80f6-8188-444b-87d8-12400e878beb-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-jwtr7\" (UID: \"e38d80f6-8188-444b-87d8-12400e878beb\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:55:26.357056 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.356933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/836f2c51-421f-4e35-a71a-52285c687c0d-metrics-tls\") pod \"dns-default-ckn8r\" (UID: \"836f2c51-421f-4e35-a71a-52285c687c0d\") " pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:55:26.650959 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.650878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2nrmg\""
Sep 16 21:55:26.651761 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.651748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pj46n\""
Sep 16 21:55:26.658015 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.658000    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"
Sep 16 21:55:26.658065 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.658023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:55:26.933949 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.933922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7"]
Sep 16 21:55:26.936908 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:55:26.936875    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38d80f6_8188_444b_87d8_12400e878beb.slice/crio-5ca9acea05038eeed83bb1a997a9b665bd9882fc7e246bf42dcee202af64833b WatchSource:0}: Error finding container 5ca9acea05038eeed83bb1a997a9b665bd9882fc7e246bf42dcee202af64833b: Status 404 returned error can't find the container with id 5ca9acea05038eeed83bb1a997a9b665bd9882fc7e246bf42dcee202af64833b
Sep 16 21:55:26.937892 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:26.937869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckn8r"]
Sep 16 21:55:26.942040 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:55:26.942015    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836f2c51_421f_4e35_a71a_52285c687c0d.slice/crio-1d9f97aeb81b5cc74af09853495e94511b5836a23322a1b8753c350be2811046 WatchSource:0}: Error finding container 1d9f97aeb81b5cc74af09853495e94511b5836a23322a1b8753c350be2811046: Status 404 returned error can't find the container with id 1d9f97aeb81b5cc74af09853495e94511b5836a23322a1b8753c350be2811046
Sep 16 21:55:27.257462 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:27.257426    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckn8r" event={"ID":"836f2c51-421f-4e35-a71a-52285c687c0d","Type":"ContainerStarted","Data":"1d9f97aeb81b5cc74af09853495e94511b5836a23322a1b8753c350be2811046"}
Sep 16 21:55:27.258486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:27.258464    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" event={"ID":"e38d80f6-8188-444b-87d8-12400e878beb","Type":"ContainerStarted","Data":"5ca9acea05038eeed83bb1a997a9b665bd9882fc7e246bf42dcee202af64833b"}
Sep 16 21:55:29.269513 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.269476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckn8r" event={"ID":"836f2c51-421f-4e35-a71a-52285c687c0d","Type":"ContainerStarted","Data":"188f91d03b069b3a87e2dd7a8688a83619cc6bd116c2f654f8b0d76042134903"}
Sep 16 21:55:29.270031 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.269526    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckn8r" event={"ID":"836f2c51-421f-4e35-a71a-52285c687c0d","Type":"ContainerStarted","Data":"19ae9bc93c7ef79b80daa592d45be48129e9c3ccca135b7c0ac36d0531ad17f7"}
Sep 16 21:55:29.270031 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.269592    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:55:29.271152 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.271132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" event={"ID":"e38d80f6-8188-444b-87d8-12400e878beb","Type":"ContainerStarted","Data":"ad0fb57d30ace8804b435091bd969ccda7916cacf9bdb8abb297f4ed3d55d6c4"}
Sep 16 21:55:29.291318 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.291273    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ckn8r" podStartSLOduration=373.529566589 podStartE2EDuration="6m15.291259767s" totalImagesPullingTime="1.761693178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:29.289347593 +0000 UTC m=+408.965536095" watchObservedRunningTime="2026-09-16 21:55:29.291259767 +0000 UTC m=+408.967448244"
Sep 16 21:55:29.305101 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:29.305057    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-jwtr7" podStartSLOduration=382.04798233 podStartE2EDuration="6m23.305043822s" totalImagesPullingTime="1.257061492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:55:29.304688444 +0000 UTC m=+408.980876924" watchObservedRunningTime="2026-09-16 21:55:29.305043822 +0000 UTC m=+408.981232300"
Sep 16 21:55:39.277221 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:55:39.277189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ckn8r"
Sep 16 21:56:55.243101 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.243069    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x4zk8"]
Sep 16 21:56:55.245948 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.245924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.248550 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.248531    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 21:56:55.248673 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.248560    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 21:56:55.249580 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.249565    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xd7ng\""
Sep 16 21:56:55.255495 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.255474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x4zk8"]
Sep 16 21:56:55.347024 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.346991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-bound-sa-token\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.347170 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.347041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckpl8\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-kube-api-access-ckpl8\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.447934 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.447892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckpl8\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-kube-api-access-ckpl8\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.448074 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.447947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-bound-sa-token\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.455755 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.455723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-bound-sa-token\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.455880 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.455791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckpl8\" (UniqueName: \"kubernetes.io/projected/4e9d97a1-ae68-439c-9fdd-becd61b5f971-kube-api-access-ckpl8\") pod \"cert-manager-55b4d954d5-x4zk8\" (UID: \"4e9d97a1-ae68-439c-9fdd-becd61b5f971\") " pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.554903 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.554821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x4zk8"
Sep 16 21:56:55.821076 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:55.820895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x4zk8"]
Sep 16 21:56:55.823950 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:56:55.823915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e9d97a1_ae68_439c_9fdd_becd61b5f971.slice/crio-75fe2385ac3537c04b19108a11c7acf4cd82485032be40a9494faba3cc9400ce WatchSource:0}: Error finding container 75fe2385ac3537c04b19108a11c7acf4cd82485032be40a9494faba3cc9400ce: Status 404 returned error can't find the container with id 75fe2385ac3537c04b19108a11c7acf4cd82485032be40a9494faba3cc9400ce
Sep 16 21:56:56.559017 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:56.558975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x4zk8" event={"ID":"4e9d97a1-ae68-439c-9fdd-becd61b5f971","Type":"ContainerStarted","Data":"75fe2385ac3537c04b19108a11c7acf4cd82485032be40a9494faba3cc9400ce"}
Sep 16 21:56:59.570583 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:59.570544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x4zk8" event={"ID":"4e9d97a1-ae68-439c-9fdd-becd61b5f971","Type":"ContainerStarted","Data":"d18143b52d98482a3588fe5c83ae3dbfd4d46d264d8ab8c199db55f9ece08c69"}
Sep 16 21:56:59.586104 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:56:59.586057    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x4zk8" podStartSLOduration=1.617954417 podStartE2EDuration="4.586042443s" totalImagesPullingTime="2.968088026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:56:59.585232694 +0000 UTC m=+499.261421183" watchObservedRunningTime="2026-09-16 21:56:59.586042443 +0000 UTC m=+499.262230921"
Sep 16 21:57:20.783743 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.783709    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"]
Sep 16 21:57:20.788147 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.788126    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.791012 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.790986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7ssw8\""
Sep 16 21:57:20.791012 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.791002    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 21:57:20.791198 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.791128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 21:57:20.791300 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.791247    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 21:57:20.791300 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.791285    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 21:57:20.808364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.808325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"]
Sep 16 21:57:20.822371 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.822349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st546\" (UniqueName: \"kubernetes.io/projected/aa0b8bbe-179d-4975-b336-362cd14b2df9-kube-api-access-st546\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.822472 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.822379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.822472 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.822423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.822472 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.822451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.822567 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.822476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923551 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923701 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923701 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923701 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st546\" (UniqueName: \"kubernetes.io/projected/aa0b8bbe-179d-4975-b336-362cd14b2df9-kube-api-access-st546\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923701 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.923964 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.923933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-manifests\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.925952 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.925922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa0b8bbe-179d-4975-b336-362cd14b2df9-tmp\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.926046 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.926032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.926145 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.926130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa0b8bbe-179d-4975-b336-362cd14b2df9-webhook-cert\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:20.930765 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:20.930746    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st546\" (UniqueName: \"kubernetes.io/projected/aa0b8bbe-179d-4975-b336-362cd14b2df9-kube-api-access-st546\") pod \"opendatahub-operator-controller-manager-8655b7f9cc-dzk22\" (UID: \"aa0b8bbe-179d-4975-b336-362cd14b2df9\") " pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:21.098077 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:21.097996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:21.375422 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:21.375394    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"]
Sep 16 21:57:21.377278 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:57:21.377253    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0b8bbe_179d_4975_b336_362cd14b2df9.slice/crio-38508c48ecdb58b5068bf338cb4a12659684e26eca5b562b3f0999e9715ac754 WatchSource:0}: Error finding container 38508c48ecdb58b5068bf338cb4a12659684e26eca5b562b3f0999e9715ac754: Status 404 returned error can't find the container with id 38508c48ecdb58b5068bf338cb4a12659684e26eca5b562b3f0999e9715ac754
Sep 16 21:57:21.643985 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:21.643883    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22" event={"ID":"aa0b8bbe-179d-4975-b336-362cd14b2df9","Type":"ContainerStarted","Data":"38508c48ecdb58b5068bf338cb4a12659684e26eca5b562b3f0999e9715ac754"}
Sep 16 21:57:24.657408 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:24.657371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22" event={"ID":"aa0b8bbe-179d-4975-b336-362cd14b2df9","Type":"ContainerStarted","Data":"f957cf808c9629ebd0bba5a463dcea95b4c8562a261657aa1801992147c876aa"}
Sep 16 21:57:25.662199 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:25.662117    2580 generic.go:356] "Generic (PLEG): container finished" podID="aa0b8bbe-179d-4975-b336-362cd14b2df9" containerID="f957cf808c9629ebd0bba5a463dcea95b4c8562a261657aa1801992147c876aa" exitCode=0
Sep 16 21:57:25.662199 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:25.662157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22" event={"ID":"aa0b8bbe-179d-4975-b336-362cd14b2df9","Type":"ContainerDied","Data":"f957cf808c9629ebd0bba5a463dcea95b4c8562a261657aa1801992147c876aa"}
Sep 16 21:57:26.668018 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:26.667982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22" event={"ID":"aa0b8bbe-179d-4975-b336-362cd14b2df9","Type":"ContainerStarted","Data":"9a5d12b5125879be9853145a4842f0e5417e648a7618eec2f4255ae9cb4f82c7"}
Sep 16 21:57:26.668501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:26.668049    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:26.688973 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:26.688933    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22" podStartSLOduration=2.526694273 podStartE2EDuration="6.688914684s" totalImagesPullingTime="3.125235266s" totalInitContainerRuntime="1.036985145s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:26.687026229 +0000 UTC m=+526.363214708" watchObservedRunningTime="2026-09-16 21:57:26.688914684 +0000 UTC m=+526.365103163"
Sep 16 21:57:37.673059 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:37.672977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8655b7f9cc-dzk22"
Sep 16 21:57:50.229751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.229712    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"]
Sep 16 21:57:50.234463 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.234436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.237149 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.237123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 21:57:50.237283 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.237215    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 21:57:50.237347 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.237166    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 21:57:50.237404 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.237135    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 21:57:50.238195 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.238171    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rmz6n\""
Sep 16 21:57:50.243234 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.243210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"]
Sep 16 21:57:50.335866 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.335827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtl2n\" (UniqueName: \"kubernetes.io/projected/58994cd8-a66d-4b39-ac3b-c4d88e44af87-kube-api-access-vtl2n\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.335866 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.335871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.336056 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.335963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tmp\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.436719 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.436678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tmp\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.436895 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.436739    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtl2n\" (UniqueName: \"kubernetes.io/projected/58994cd8-a66d-4b39-ac3b-c4d88e44af87-kube-api-access-vtl2n\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.436895 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.436864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.439130 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.439107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tmp\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.439257 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.439229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58994cd8-a66d-4b39-ac3b-c4d88e44af87-tls-certs\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.462181 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.462153    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nt6s"]
Sep 16 21:57:50.464751 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.464723    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtl2n\" (UniqueName: \"kubernetes.io/projected/58994cd8-a66d-4b39-ac3b-c4d88e44af87-kube-api-access-vtl2n\") pod \"kube-auth-proxy-6c57876cd9-x9cln\" (UID: \"58994cd8-a66d-4b39-ac3b-c4d88e44af87\") " pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.465791 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.465772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.468810 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.468788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dlkf8\""
Sep 16 21:57:50.469418 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.469387    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 21:57:50.480695 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.480646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nt6s"]
Sep 16 21:57:50.537752 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.537713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.537959 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.537793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5qw7\" (UniqueName: \"kubernetes.io/projected/1bb95b52-f610-4436-95f4-63e5f680b772-kube-api-access-q5qw7\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.545660 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.545629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"
Sep 16 21:57:50.638404 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.638376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.638584 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.638430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5qw7\" (UniqueName: \"kubernetes.io/projected/1bb95b52-f610-4436-95f4-63e5f680b772-kube-api-access-q5qw7\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.638584 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:57:50.638567    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 16 21:57:50.638715 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:57:50.638661    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert podName:1bb95b52-f610-4436-95f4-63e5f680b772 nodeName:}" failed. No retries permitted until 2026-09-16 21:57:51.138640572 +0000 UTC m=+550.814829041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert") pod "odh-model-controller-7998c67dc4-2nt6s" (UID: "1bb95b52-f610-4436-95f4-63e5f680b772") : secret "odh-model-controller-webhook-cert" not found
Sep 16 21:57:50.650481 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.650453    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5qw7\" (UniqueName: \"kubernetes.io/projected/1bb95b52-f610-4436-95f4-63e5f680b772-kube-api-access-q5qw7\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:50.822871 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:50.822801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln"]
Sep 16 21:57:50.825415 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:57:50.825384    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58994cd8_a66d_4b39_ac3b_c4d88e44af87.slice/crio-78ca9bea3663fdc99ec995210c1c2fbc2435cb4e16d6f5c396544d178197e2c2 WatchSource:0}: Error finding container 78ca9bea3663fdc99ec995210c1c2fbc2435cb4e16d6f5c396544d178197e2c2: Status 404 returned error can't find the container with id 78ca9bea3663fdc99ec995210c1c2fbc2435cb4e16d6f5c396544d178197e2c2
Sep 16 21:57:51.142692 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.142578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:51.145043 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.145014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bb95b52-f610-4436-95f4-63e5f680b772-cert\") pod \"odh-model-controller-7998c67dc4-2nt6s\" (UID: \"1bb95b52-f610-4436-95f4-63e5f680b772\") " pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:51.378565 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.378532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:51.380686 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.380654    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:57:51.383535 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.383518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.386955 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.386933    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 21:57:51.387065 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.386933    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 21:57:51.387065 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.386972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 21:57:51.387065 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.386980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wkbv6\""
Sep 16 21:57:51.388052 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.388025    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 21:57:51.424038 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.423955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:57:51.446052 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446168 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446168 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446168 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vzl6\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446233    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.446337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.446266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.546923 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.546887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.546932    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.546968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.547014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vzl6\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.547057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.547085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.547120 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.547104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.548248 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.548216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.550011 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.549960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.550011 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.549977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.550706 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.550683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.550811 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.550777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.555228 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.555203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.555741 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.555720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vzl6\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6\") pod \"istiod-openshift-gateway-7b7995d5cd-sdtwq\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.650775 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.650660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2nt6s"]
Sep 16 21:57:51.658069 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:57:51.654112    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb95b52_f610_4436_95f4_63e5f680b772.slice/crio-54c9487d0a4cedd011696aa46640d61c157a4ea829ff539cd70ced5f86b675eb WatchSource:0}: Error finding container 54c9487d0a4cedd011696aa46640d61c157a4ea829ff539cd70ced5f86b675eb: Status 404 returned error can't find the container with id 54c9487d0a4cedd011696aa46640d61c157a4ea829ff539cd70ced5f86b675eb
Sep 16 21:57:51.693525 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.693459    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:51.759330 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.758804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s" event={"ID":"1bb95b52-f610-4436-95f4-63e5f680b772","Type":"ContainerStarted","Data":"54c9487d0a4cedd011696aa46640d61c157a4ea829ff539cd70ced5f86b675eb"}
Sep 16 21:57:51.764397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.764359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln" event={"ID":"58994cd8-a66d-4b39-ac3b-c4d88e44af87","Type":"ContainerStarted","Data":"78ca9bea3663fdc99ec995210c1c2fbc2435cb4e16d6f5c396544d178197e2c2"}
Sep 16 21:57:51.986796 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:51.986762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:57:51.990569 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:57:51.990537    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c5e6c6_4d47_47a8_9222_0eb1c689a1b8.slice/crio-329b1f68bbff00512c008e1c1a9416b22f75f0371f610bc09d5326a4cd47ac89 WatchSource:0}: Error finding container 329b1f68bbff00512c008e1c1a9416b22f75f0371f610bc09d5326a4cd47ac89: Status 404 returned error can't find the container with id 329b1f68bbff00512c008e1c1a9416b22f75f0371f610bc09d5326a4cd47ac89
Sep 16 21:57:52.771432 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:52.771391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" event={"ID":"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8","Type":"ContainerStarted","Data":"329b1f68bbff00512c008e1c1a9416b22f75f0371f610bc09d5326a4cd47ac89"}
Sep 16 21:57:55.784240 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:55.784197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s" event={"ID":"1bb95b52-f610-4436-95f4-63e5f680b772","Type":"ContainerStarted","Data":"940f7407476af473c9597b9d35483e7e60ac1a5b3e9bfc0ee10b953ca09d0c84"}
Sep 16 21:57:55.784665 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:55.784332    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:57:55.785756 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:55.785733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln" event={"ID":"58994cd8-a66d-4b39-ac3b-c4d88e44af87","Type":"ContainerStarted","Data":"79e9be588ee1e079f608f3810e8b3e72e2ad1ba456f8a31c0c8bf171db438bf7"}
Sep 16 21:57:55.799946 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:55.799904    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s" podStartSLOduration=2.13986671 podStartE2EDuration="5.799874934s" totalImagesPullingTime="3.660008224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:55.798676346 +0000 UTC m=+555.474864823" watchObservedRunningTime="2026-09-16 21:57:55.799874934 +0000 UTC m=+555.476063411"
Sep 16 21:57:55.813924 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:55.813883    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c57876cd9-x9cln" podStartSLOduration=1.361261286 podStartE2EDuration="5.813871526s" totalImagesPullingTime="4.45261024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:55.813282006 +0000 UTC m=+555.489470489" watchObservedRunningTime="2026-09-16 21:57:55.813871526 +0000 UTC m=+555.490060004"
Sep 16 21:57:58.747560 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:58.747520    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 21:57:58.747867 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:58.747600    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 21:57:59.804864 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:59.804832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" event={"ID":"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8","Type":"ContainerStarted","Data":"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"}
Sep 16 21:57:59.805251 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:59.805028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:57:59.806407 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:59.806382    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-sdtwq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 21:57:59.806528 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:57:59.806427    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 21:58:00.647235 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.647173    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" podStartSLOduration=2.893038396 podStartE2EDuration="9.64713139s" totalImagesPullingTime="6.754092994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:57:59.87110193 +0000 UTC m=+559.547290407" watchObservedRunningTime="2026-09-16 21:58:00.64713139 +0000 UTC m=+560.323319870"
Sep 16 21:58:00.649194 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.649168    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"]
Sep 16 21:58:00.652033 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.652011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.654992 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.654971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-884xk\""
Sep 16 21:58:00.666242 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.666135    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"]
Sep 16 21:58:00.725923 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.725896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.725927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.725944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.725965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.725996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726340 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.726105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726340 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.726155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v5gf\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-kube-api-access-6v5gf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726340 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.726186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f612e233-d4c3-4eb8-b325-0c03831e5ede-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.726340 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.726221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.809080 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.809056    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:58:00.826952 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.826923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827081 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.826959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827081 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.826979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v5gf\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-kube-api-access-6v5gf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827081 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f612e233-d4c3-4eb8-b325-0c03831e5ede-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827081 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827081 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827337 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827498 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827556 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827644 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827620    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827710 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.827925 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.827904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f612e233-d4c3-4eb8-b325-0c03831e5ede-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.829234 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.829218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.829514 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.829497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.842106 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.842076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v5gf\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-kube-api-access-6v5gf\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.847480 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.847459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f612e233-d4c3-4eb8-b325-0c03831e5ede-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl\" (UID: \"f612e233-d4c3-4eb8-b325-0c03831e5ede\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:00.966149 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:00.966072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:01.245056 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.245022    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"]
Sep 16 21:58:01.249043 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:58:01.249011    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf612e233_d4c3_4eb8_b325_0c03831e5ede.slice/crio-e8e16e8a74a68ab9d3daef637c9c3b004e4de968f2e0a9bce76d9de46259913f WatchSource:0}: Error finding container e8e16e8a74a68ab9d3daef637c9c3b004e4de968f2e0a9bce76d9de46259913f: Status 404 returned error can't find the container with id e8e16e8a74a68ab9d3daef637c9c3b004e4de968f2e0a9bce76d9de46259913f
Sep 16 21:58:01.338598 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.338559    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"]
Sep 16 21:58:01.342945 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.342924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.345690 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.345668    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 21:58:01.345805 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.345785    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kmpnn\""
Sep 16 21:58:01.352755 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.352734    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"]
Sep 16 21:58:01.356149 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.356130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"]
Sep 16 21:58:01.356248 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.356215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.359400 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.359380    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 21:58:01.359672 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.359655    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9x889\""
Sep 16 21:58:01.367942 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.367917    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"]
Sep 16 21:58:01.432703 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.432677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.432838 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.432712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6caf64d8-7d5b-48da-8ab5-6e49bff08399-cert\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.432838 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.432798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgmb\" (UniqueName: \"kubernetes.io/projected/6caf64d8-7d5b-48da-8ab5-6e49bff08399-kube-api-access-5mgmb\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.432838 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.432834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqr6j\" (UniqueName: \"kubernetes.io/projected/b9f8411d-64b5-4183-a873-a0182c13480e-kube-api-access-mqr6j\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.534038 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.533964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgmb\" (UniqueName: \"kubernetes.io/projected/6caf64d8-7d5b-48da-8ab5-6e49bff08399-kube-api-access-5mgmb\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.534038 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.534002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr6j\" (UniqueName: \"kubernetes.io/projected/b9f8411d-64b5-4183-a873-a0182c13480e-kube-api-access-mqr6j\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.534230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.534071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.534230 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.534093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6caf64d8-7d5b-48da-8ab5-6e49bff08399-cert\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.534230 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:58:01.534185    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 16 21:58:01.534372 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:58:01.534240    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert podName:b9f8411d-64b5-4183-a873-a0182c13480e nodeName:}" failed. No retries permitted until 2026-09-16 21:58:02.034222333 +0000 UTC m=+561.710410794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert") pod "llmisvc-controller-manager-777c6bd7d5-s5kgv" (UID: "b9f8411d-64b5-4183-a873-a0182c13480e") : secret "llmisvc-webhook-server-cert" not found
Sep 16 21:58:01.536439 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.536415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6caf64d8-7d5b-48da-8ab5-6e49bff08399-cert\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.549883 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.549860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqr6j\" (UniqueName: \"kubernetes.io/projected/b9f8411d-64b5-4183-a873-a0182c13480e-kube-api-access-mqr6j\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:01.549994 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.549893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgmb\" (UniqueName: \"kubernetes.io/projected/6caf64d8-7d5b-48da-8ab5-6e49bff08399-kube-api-access-5mgmb\") pod \"kserve-controller-manager-d6f4b65b8-wchdd\" (UID: \"6caf64d8-7d5b-48da-8ab5-6e49bff08399\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.653369 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.653335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:01.813418 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.813337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl" event={"ID":"f612e233-d4c3-4eb8-b325-0c03831e5ede","Type":"ContainerStarted","Data":"e8e16e8a74a68ab9d3daef637c9c3b004e4de968f2e0a9bce76d9de46259913f"}
Sep 16 21:58:01.920344 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:01.920311    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"]
Sep 16 21:58:01.922972 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:58:01.922945    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6caf64d8_7d5b_48da_8ab5_6e49bff08399.slice/crio-f507dbd93d5f3ba94142d61f1afa177304e5bb3cf884b8b229aa2c3a0f87671e WatchSource:0}: Error finding container f507dbd93d5f3ba94142d61f1afa177304e5bb3cf884b8b229aa2c3a0f87671e: Status 404 returned error can't find the container with id f507dbd93d5f3ba94142d61f1afa177304e5bb3cf884b8b229aa2c3a0f87671e
Sep 16 21:58:02.037820 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.037788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:02.040130 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.040108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9f8411d-64b5-4183-a873-a0182c13480e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s5kgv\" (UID: \"b9f8411d-64b5-4183-a873-a0182c13480e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:02.265172 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.265141    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:02.542669 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.542569    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"]
Sep 16 21:58:02.545423 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:58:02.545398    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb9f8411d_64b5_4183_a873_a0182c13480e.slice/crio-2cf615f433e65362dc283031faf2ef4565f5c125d46f3018bad3eef0377b9796 WatchSource:0}: Error finding container 2cf615f433e65362dc283031faf2ef4565f5c125d46f3018bad3eef0377b9796: Status 404 returned error can't find the container with id 2cf615f433e65362dc283031faf2ef4565f5c125d46f3018bad3eef0377b9796
Sep 16 21:58:02.819939 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.819832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv" event={"ID":"b9f8411d-64b5-4183-a873-a0182c13480e","Type":"ContainerStarted","Data":"2cf615f433e65362dc283031faf2ef4565f5c125d46f3018bad3eef0377b9796"}
Sep 16 21:58:02.821185 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:02.821151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd" event={"ID":"6caf64d8-7d5b-48da-8ab5-6e49bff08399","Type":"ContainerStarted","Data":"f507dbd93d5f3ba94142d61f1afa177304e5bb3cf884b8b229aa2c3a0f87671e"}
Sep 16 21:58:04.204844 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:04.204810    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:58:04.205291 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:04.205030    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerName="discovery" containerID="cri-o://9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893" gracePeriod=30
Sep 16 21:58:05.216515 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.216492    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:58:05.366119 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366032    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366119 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366119 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366099    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366303    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366397 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366369    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vzl6\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366501 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366484    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.366838 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.366553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap\") pod \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\" (UID: \"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8\") "
Sep 16 21:58:05.367179 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.367150    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 21:58:05.369281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.369254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6" (OuterVolumeSpecName: "kube-api-access-7vzl6") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "kube-api-access-7vzl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:58:05.369281 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.369269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts" (OuterVolumeSpecName: "cacerts") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:58:05.369888 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.369792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:58:05.369888 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.369856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 21:58:05.369888 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.369857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:58:05.370076 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.370018    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs" (OuterVolumeSpecName: "local-certs") pod "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" (UID: "23c5e6c6-4d47-47a8-9222-0eb1c689a1b8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:58:05.378699 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.378597    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 21:58:05.378826 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.378709    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 21:58:05.378826 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.378779    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 21:58:05.468269 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468234    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-dns-cert\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468269 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468269    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-local-certs\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468452 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468284    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-token\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468452 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468297    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-cacerts\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468452 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468311    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vzl6\" (UniqueName: \"kubernetes.io/projected/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-kube-api-access-7vzl6\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468452 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468325    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-kubeconfig\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.468452 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.468338    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8-istio-csr-ca-configmap\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:58:05.836549 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.836511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd" event={"ID":"6caf64d8-7d5b-48da-8ab5-6e49bff08399","Type":"ContainerStarted","Data":"38a8a5896b34cf6623ad90eae8d62e178d69c1925cd13c52eed185eda05f7fb7"}
Sep 16 21:58:05.836713 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.836653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:05.839364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.838841    2580 generic.go:356] "Generic (PLEG): container finished" podID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerID="9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893" exitCode=0
Sep 16 21:58:05.839364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.838923    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" event={"ID":"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8","Type":"ContainerDied","Data":"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"}
Sep 16 21:58:05.839364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.838959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq" event={"ID":"23c5e6c6-4d47-47a8-9222-0eb1c689a1b8","Type":"ContainerDied","Data":"329b1f68bbff00512c008e1c1a9416b22f75f0371f610bc09d5326a4cd47ac89"}
Sep 16 21:58:05.839364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.838984    2580 scope.go:117] "RemoveContainer" containerID="9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"
Sep 16 21:58:05.839364 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.839116    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"
Sep 16 21:58:05.842064 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.842042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl" event={"ID":"f612e233-d4c3-4eb8-b325-0c03831e5ede","Type":"ContainerStarted","Data":"5f7c6f4f285698335744296e3d3f51d2b509aaf369d0f226313162768fe12dd0"}
Sep 16 21:58:05.851471 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.851432    2580 scope.go:117] "RemoveContainer" containerID="9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"
Sep 16 21:58:05.852186 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:58:05.851923    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893\": container with ID starting with 9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893 not found: ID does not exist" containerID="9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"
Sep 16 21:58:05.852186 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.851971    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893"} err="failed to get container status \"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893\": rpc error: code = NotFound desc = could not find container \"9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893\": container with ID starting with 9cfef0b9ae3f1edf117b34ddabe7b5b7681a0110e3f862480fe2014a20771893 not found: ID does not exist"
Sep 16 21:58:05.852443 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.852400    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd" podStartSLOduration=1.578953114 podStartE2EDuration="4.852383973s" totalImagesPullingTime="3.273430859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:05.851630959 +0000 UTC m=+565.527819435" watchObservedRunningTime="2026-09-16 21:58:05.852383973 +0000 UTC m=+565.528572458"
Sep 16 21:58:05.868556 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.868204    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:58:05.871662 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.871587    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sdtwq"]
Sep 16 21:58:05.966390 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:05.966295    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:06.791756 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:06.791726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2nt6s"
Sep 16 21:58:06.825671 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:06.825587    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl" podStartSLOduration=2.699245269 podStartE2EDuration="6.825570986s" totalImagesPullingTime="4.126325717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:05.893159103 +0000 UTC m=+565.569347583" watchObservedRunningTime="2026-09-16 21:58:06.825570986 +0000 UTC m=+566.501759464"
Sep 16 21:58:06.960097 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:06.960060    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" path="/var/lib/kubelet/pods/23c5e6c6-4d47-47a8-9222-0eb1c689a1b8/volumes"
Sep 16 21:58:06.973430 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:06.973401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:07.859874 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:07.859833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv" event={"ID":"b9f8411d-64b5-4183-a873-a0182c13480e","Type":"ContainerStarted","Data":"27cecf25d8f7b4398e6f2249bc6a5740671d28c72aacb5efc194d03e81c51016"}
Sep 16 21:58:07.860422 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:07.859958    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:07.860422 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:07.860132    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:58:07.861019 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:07.861001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl"
Sep 16 21:58:07.877922 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:07.877856    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv" podStartSLOduration=2.258728285 podStartE2EDuration="6.877845311s" totalImagesPullingTime="4.619117026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:58:07.876132171 +0000 UTC m=+567.552320650" watchObservedRunningTime="2026-09-16 21:58:07.877845311 +0000 UTC m=+567.554033789"
Sep 16 21:58:36.854153 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:36.854118    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wchdd"
Sep 16 21:58:38.865832 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:58:38.865799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 21:59:27.450323 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.450288    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"]
Sep 16 21:59:27.450753 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.450561    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerName="discovery"
Sep 16 21:59:27.450753 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.450572    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerName="discovery"
Sep 16 21:59:27.450753 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.450636    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c5e6c6-4d47-47a8-9222-0eb1c689a1b8" containerName="discovery"
Sep 16 21:59:27.453485 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.453471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.456163 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.456140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dm775\""
Sep 16 21:59:27.456399 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.456385    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 21:59:27.456651 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.456634    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 21:59:27.466667 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.466644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"]
Sep 16 21:59:27.616006 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.615967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vw5x\" (UniqueName: \"kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.616200 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.616025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.717330 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.717244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vw5x\" (UniqueName: \"kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.717330 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.717294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.717660 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.717643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.732129 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.732098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vw5x\" (UniqueName: \"kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:27.762974 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:27.762943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:28.042472 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:28.042446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"]
Sep 16 21:59:28.045167 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:28.045141    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ecdc58_d89d_48d5_8c55_ad07c94df42a.slice/crio-16b15a69e2d8f916629e9f9c8341336c15734747d4d248b656b803b642d6215f WatchSource:0}: Error finding container 16b15a69e2d8f916629e9f9c8341336c15734747d4d248b656b803b642d6215f: Status 404 returned error can't find the container with id 16b15a69e2d8f916629e9f9c8341336c15734747d4d248b656b803b642d6215f
Sep 16 21:59:28.047775 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:28.047754    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 21:59:28.171762 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:28.171728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq" event={"ID":"f3ecdc58-d89d-48d5-8c55-ad07c94df42a","Type":"ContainerStarted","Data":"16b15a69e2d8f916629e9f9c8341336c15734747d4d248b656b803b642d6215f"}
Sep 16 21:59:29.451743 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.451709    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"]
Sep 16 21:59:29.456102 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.456081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:29.458593 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.458568    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 21:59:29.458740 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.458721    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gr6n8\""
Sep 16 21:59:29.465396 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.465375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"]
Sep 16 21:59:29.532459 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.532416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89sl8\" (UniqueName: \"kubernetes.io/projected/e91a922a-7632-420e-83d4-29ab5a530aad-kube-api-access-89sl8\") pod \"dns-operator-controller-manager-7b84cd7c9c-kvhc4\" (UID: \"e91a922a-7632-420e-83d4-29ab5a530aad\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:29.633379 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.633343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89sl8\" (UniqueName: \"kubernetes.io/projected/e91a922a-7632-420e-83d4-29ab5a530aad-kube-api-access-89sl8\") pod \"dns-operator-controller-manager-7b84cd7c9c-kvhc4\" (UID: \"e91a922a-7632-420e-83d4-29ab5a530aad\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:29.646986 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.646957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89sl8\" (UniqueName: \"kubernetes.io/projected/e91a922a-7632-420e-83d4-29ab5a530aad-kube-api-access-89sl8\") pod \"dns-operator-controller-manager-7b84cd7c9c-kvhc4\" (UID: \"e91a922a-7632-420e-83d4-29ab5a530aad\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:29.766870 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:29.766831    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:30.042052 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:30.042028    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"]
Sep 16 21:59:30.044512 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:30.044481    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91a922a_7632_420e_83d4_29ab5a530aad.slice/crio-cf625caf3f49f40655bebd8ea49623727361a846e2bb7c6ba6ac5d19bf8dc301 WatchSource:0}: Error finding container cf625caf3f49f40655bebd8ea49623727361a846e2bb7c6ba6ac5d19bf8dc301: Status 404 returned error can't find the container with id cf625caf3f49f40655bebd8ea49623727361a846e2bb7c6ba6ac5d19bf8dc301
Sep 16 21:59:30.180935 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:30.180901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4" event={"ID":"e91a922a-7632-420e-83d4-29ab5a530aad","Type":"ContainerStarted","Data":"cf625caf3f49f40655bebd8ea49623727361a846e2bb7c6ba6ac5d19bf8dc301"}
Sep 16 21:59:32.278300 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.278265    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5j6ln"]
Sep 16 21:59:32.281876 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.281851    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:32.286417 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.286391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49wfk\""
Sep 16 21:59:32.297118 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.297090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5j6ln"]
Sep 16 21:59:32.354436 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.354297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddfxk\" (UniqueName: \"kubernetes.io/projected/bd118c84-342f-42f1-b287-5fa9c4dac4da-kube-api-access-ddfxk\") pod \"authorino-operator-76b478bd78-5j6ln\" (UID: \"bd118c84-342f-42f1-b287-5fa9c4dac4da\") " pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:32.455486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.455341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddfxk\" (UniqueName: \"kubernetes.io/projected/bd118c84-342f-42f1-b287-5fa9c4dac4da-kube-api-access-ddfxk\") pod \"authorino-operator-76b478bd78-5j6ln\" (UID: \"bd118c84-342f-42f1-b287-5fa9c4dac4da\") " pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:32.469918 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.469877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddfxk\" (UniqueName: \"kubernetes.io/projected/bd118c84-342f-42f1-b287-5fa9c4dac4da-kube-api-access-ddfxk\") pod \"authorino-operator-76b478bd78-5j6ln\" (UID: \"bd118c84-342f-42f1-b287-5fa9c4dac4da\") " pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:32.600735 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:32.600652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:33.973635 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:33.973502    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-5j6ln"]
Sep 16 21:59:34.336513 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.336480    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"]
Sep 16 21:59:34.340626 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.340591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:34.343333 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.343308    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9k6xk\""
Sep 16 21:59:34.349202 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.349157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"]
Sep 16 21:59:34.371628 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.371573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5vx\" (UniqueName: \"kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx\") pod \"limitador-operator-controller-manager-74495c69f8-vdw2v\" (UID: \"fb26c49f-55ec-4a16-9beb-598c231f0e15\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:34.472978 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.472940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5vx\" (UniqueName: \"kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx\") pod \"limitador-operator-controller-manager-74495c69f8-vdw2v\" (UID: \"fb26c49f-55ec-4a16-9beb-598c231f0e15\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:34.485578 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.485550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5vx\" (UniqueName: \"kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx\") pod \"limitador-operator-controller-manager-74495c69f8-vdw2v\" (UID: \"fb26c49f-55ec-4a16-9beb-598c231f0e15\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:34.654891 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:34.654798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:35.000476 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:35.000436    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd118c84_342f_42f1_b287_5fa9c4dac4da.slice/crio-f2bda07b4e5a0a04fe05d0ae784c27f5eb289ffdc8dc331166c27eeccdcc098d WatchSource:0}: Error finding container f2bda07b4e5a0a04fe05d0ae784c27f5eb289ffdc8dc331166c27eeccdcc098d: Status 404 returned error can't find the container with id f2bda07b4e5a0a04fe05d0ae784c27f5eb289ffdc8dc331166c27eeccdcc098d
Sep 16 21:59:35.209333 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.209290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq" event={"ID":"f3ecdc58-d89d-48d5-8c55-ad07c94df42a","Type":"ContainerStarted","Data":"cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7"}
Sep 16 21:59:35.209523 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.209363    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:35.210958 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.210930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4" event={"ID":"e91a922a-7632-420e-83d4-29ab5a530aad","Type":"ContainerStarted","Data":"4b33f6cac27e98618cdd18cf005b63dcc4b908e016660e194524e7a24f073c0a"}
Sep 16 21:59:35.211084 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.210985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:35.212295 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.212262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln" event={"ID":"bd118c84-342f-42f1-b287-5fa9c4dac4da","Type":"ContainerStarted","Data":"f2bda07b4e5a0a04fe05d0ae784c27f5eb289ffdc8dc331166c27eeccdcc098d"}
Sep 16 21:59:35.235372 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.235316    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq" podStartSLOduration=1.200857503 podStartE2EDuration="8.235295145s" totalImagesPullingTime="7.034437642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:35.233356252 +0000 UTC m=+654.909544757" watchObservedRunningTime="2026-09-16 21:59:35.235295145 +0000 UTC m=+654.911483626"
Sep 16 21:59:35.251451 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.251331    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4" podStartSLOduration=1.2859642230000001 podStartE2EDuration="6.251310227s" totalImagesPullingTime="4.965346004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:35.249831958 +0000 UTC m=+654.926020464" watchObservedRunningTime="2026-09-16 21:59:35.251310227 +0000 UTC m=+654.927498704"
Sep 16 21:59:35.272270 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:35.272178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"]
Sep 16 21:59:35.275079 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:35.275056    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb26c49f_55ec_4a16_9beb_598c231f0e15.slice/crio-7a0f781c0d6e794edb5d5839fa9dda935836c915af7e203d042860b5cb47694a WatchSource:0}: Error finding container 7a0f781c0d6e794edb5d5839fa9dda935836c915af7e203d042860b5cb47694a: Status 404 returned error can't find the container with id 7a0f781c0d6e794edb5d5839fa9dda935836c915af7e203d042860b5cb47694a
Sep 16 21:59:36.220430 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:36.220383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v" event={"ID":"fb26c49f-55ec-4a16-9beb-598c231f0e15","Type":"ContainerStarted","Data":"7a0f781c0d6e794edb5d5839fa9dda935836c915af7e203d042860b5cb47694a"}
Sep 16 21:59:37.228366 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.228255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln" event={"ID":"bd118c84-342f-42f1-b287-5fa9c4dac4da","Type":"ContainerStarted","Data":"dc481940a1125de6d7635e82f48726c00b2bc82761823b456f55cb0820433292"}
Sep 16 21:59:37.228850 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.228391    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:37.231079 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.231007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v" event={"ID":"fb26c49f-55ec-4a16-9beb-598c231f0e15","Type":"ContainerStarted","Data":"72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081"}
Sep 16 21:59:37.231227 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.231180    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:37.245600 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.245551    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln" podStartSLOduration=3.314768628 podStartE2EDuration="5.245534781s" totalImagesPullingTime="1.930766153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:37.244552045 +0000 UTC m=+656.920740526" watchObservedRunningTime="2026-09-16 21:59:37.245534781 +0000 UTC m=+656.921723259"
Sep 16 21:59:37.261747 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:37.261699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v" podStartSLOduration=1.550442265 podStartE2EDuration="3.261686052s" totalImagesPullingTime="1.711243787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:37.260552493 +0000 UTC m=+656.936740972" watchObservedRunningTime="2026-09-16 21:59:37.261686052 +0000 UTC m=+656.937874531"
Sep 16 21:59:46.222732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:46.222696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kvhc4"
Sep 16 21:59:46.223108 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:46.222874    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.237763 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.237727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.238143 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.237810    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-5j6ln"
Sep 16 21:59:48.445586 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.445549    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"]
Sep 16 21:59:48.445781 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.445752    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" containerName="manager" containerID="cri-o://cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7" gracePeriod=2
Sep 16 21:59:48.460737 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.460713    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"]
Sep 16 21:59:48.473362 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.473331    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\": pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.475734 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.475712    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 21:59:48.476051 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.476037    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" containerName="manager"
Sep 16 21:59:48.476105 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.476053    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" containerName="manager"
Sep 16 21:59:48.476144 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.476113    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" containerName="manager"
Sep 16 21:59:48.478990 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.478919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.481179 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.481155    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"]
Sep 16 21:59:48.481384 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.481358    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" containerName="manager" containerID="cri-o://72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081" gracePeriod=2
Sep 16 21:59:48.486096 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.486074    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"]
Sep 16 21:59:48.493537 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.493474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 21:59:48.510413 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.510391    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"]
Sep 16 21:59:48.510871 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.510852    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" containerName="manager"
Sep 16 21:59:48.510917 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.510875    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" containerName="manager"
Sep 16 21:59:48.510961 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.510950    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" containerName="manager"
Sep 16 21:59:48.514011 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.513990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:48.526462 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.526001    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.528817 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.528797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"]
Sep 16 21:59:48.548832 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.548805    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdw2v\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.550782 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.550757    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.581272 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.581241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.581367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.581279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dzl\" (UniqueName: \"kubernetes.io/projected/bcf6f240-7a68-4c3e-a7f5-faf2133f7933-kube-api-access-w7dzl\") pod \"limitador-operator-controller-manager-74495c69f8-x4f5m\" (UID: \"bcf6f240-7a68-4c3e-a7f5-faf2133f7933\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:48.581367 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.581303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhd5d\" (UniqueName: \"kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.682329 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.682297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.682486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.682354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dzl\" (UniqueName: \"kubernetes.io/projected/bcf6f240-7a68-4c3e-a7f5-faf2133f7933-kube-api-access-w7dzl\") pod \"limitador-operator-controller-manager-74495c69f8-x4f5m\" (UID: \"bcf6f240-7a68-4c3e-a7f5-faf2133f7933\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:48.682486 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.682399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhd5d\" (UniqueName: \"kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.682749 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.682726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.708858 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.708829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhd5d\" (UniqueName: \"kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hr8mx\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.708964 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.708938    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dzl\" (UniqueName: \"kubernetes.io/projected/bcf6f240-7a68-4c3e-a7f5-faf2133f7933-kube-api-access-w7dzl\") pod \"limitador-operator-controller-manager-74495c69f8-x4f5m\" (UID: \"bcf6f240-7a68-4c3e-a7f5-faf2133f7933\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:48.725970 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.725947    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.727945 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.727927    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.729657 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.729632    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdw2v\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.733478 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.733455    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.737907 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.737887    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.741483 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.741463    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdw2v\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.777597 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.777505    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"]
Sep 16 21:59:48.780642 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.780619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.783001 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.782981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume\") pod \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") "
Sep 16 21:59:48.783075 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.783040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t5vx\" (UniqueName: \"kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx\") pod \"fb26c49f-55ec-4a16-9beb-598c231f0e15\" (UID: \"fb26c49f-55ec-4a16-9beb-598c231f0e15\") "
Sep 16 21:59:48.783075 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.783062    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vw5x\" (UniqueName: \"kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x\") pod \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\" (UID: \"f3ecdc58-d89d-48d5-8c55-ad07c94df42a\") "
Sep 16 21:59:48.783357 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.783327    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3ecdc58-d89d-48d5-8c55-ad07c94df42a" (UID: "f3ecdc58-d89d-48d5-8c55-ad07c94df42a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 21:59:48.784678 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.784641    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdw2v\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:48.785409 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.785384    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x" (OuterVolumeSpecName: "kube-api-access-8vw5x") pod "f3ecdc58-d89d-48d5-8c55-ad07c94df42a" (UID: "f3ecdc58-d89d-48d5-8c55-ad07c94df42a"). InnerVolumeSpecName "kube-api-access-8vw5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:59:48.785483 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.785417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx" (OuterVolumeSpecName: "kube-api-access-4t5vx") pod "fb26c49f-55ec-4a16-9beb-598c231f0e15" (UID: "fb26c49f-55ec-4a16-9beb-598c231f0e15"). InnerVolumeSpecName "kube-api-access-4t5vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 21:59:48.799493 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.799471    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"]
Sep 16 21:59:48.821227 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:48.821198    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-jzxfq\" is forbidden: User \"system:node:ip-10-0-129-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-128.ec2.internal' and this object" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:48.883503 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.883476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8jmn\" (UniqueName: \"kubernetes.io/projected/3f5156c7-1467-41f1-ada6-617826dbcd2f-kube-api-access-q8jmn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.883651 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.883544    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5156c7-1467-41f1-ada6-617826dbcd2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.883651 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.883630    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t5vx\" (UniqueName: \"kubernetes.io/projected/fb26c49f-55ec-4a16-9beb-598c231f0e15-kube-api-access-4t5vx\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:59:48.883651 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.883646    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vw5x\" (UniqueName: \"kubernetes.io/projected/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-kube-api-access-8vw5x\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:59:48.883781 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.883658    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3ecdc58-d89d-48d5-8c55-ad07c94df42a-extensions-socket-volume\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 21:59:48.892471 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.892202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:48.896880 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.896857    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:48.961812 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.961782    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" path="/var/lib/kubelet/pods/f3ecdc58-d89d-48d5-8c55-ad07c94df42a/volumes"
Sep 16 21:59:48.962087 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.962074    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb26c49f-55ec-4a16-9beb-598c231f0e15" path="/var/lib/kubelet/pods/fb26c49f-55ec-4a16-9beb-598c231f0e15/volumes"
Sep 16 21:59:48.984388 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.984366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8jmn\" (UniqueName: \"kubernetes.io/projected/3f5156c7-1467-41f1-ada6-617826dbcd2f-kube-api-access-q8jmn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.984480 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.984432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5156c7-1467-41f1-ada6-617826dbcd2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.984927 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.984896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f5156c7-1467-41f1-ada6-617826dbcd2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:48.995366 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:48.995322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8jmn\" (UniqueName: \"kubernetes.io/projected/3f5156c7-1467-41f1-ada6-617826dbcd2f-kube-api-access-q8jmn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fb8x7\" (UID: \"3f5156c7-1467-41f1-ada6-617826dbcd2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:49.090920 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.090853    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:49.171269 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.171244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 21:59:49.177099 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:49.177075    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6aaac1_b53a_47c7_9ec9_7d7a9ce0bbac.slice/crio-a128b38107a66a836d6c25a4e09b07bd99dcff207dd3a3e307047b349e318dab WatchSource:0}: Error finding container a128b38107a66a836d6c25a4e09b07bd99dcff207dd3a3e307047b349e318dab: Status 404 returned error can't find the container with id a128b38107a66a836d6c25a4e09b07bd99dcff207dd3a3e307047b349e318dab
Sep 16 21:59:49.180483 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.180457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"]
Sep 16 21:59:49.183741 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:49.183717    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf6f240_7a68_4c3e_a7f5_faf2133f7933.slice/crio-7c441a24c42653aeb222fae1ffd5d08f5966c296b0bf1132616e66a261c1f581 WatchSource:0}: Error finding container 7c441a24c42653aeb222fae1ffd5d08f5966c296b0bf1132616e66a261c1f581: Status 404 returned error can't find the container with id 7c441a24c42653aeb222fae1ffd5d08f5966c296b0bf1132616e66a261c1f581
Sep 16 21:59:49.284384 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.284356    2580 generic.go:356] "Generic (PLEG): container finished" podID="fb26c49f-55ec-4a16-9beb-598c231f0e15" containerID="72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081" exitCode=0
Sep 16 21:59:49.284737 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.284418    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdw2v"
Sep 16 21:59:49.284737 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.284440    2580 scope.go:117] "RemoveContainer" containerID="72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081"
Sep 16 21:59:49.286235 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.286212    2580 generic.go:356] "Generic (PLEG): container finished" podID="f3ecdc58-d89d-48d5-8c55-ad07c94df42a" containerID="cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7" exitCode=0
Sep 16 21:59:49.286345 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.286273    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jzxfq"
Sep 16 21:59:49.288633 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.288584    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m" event={"ID":"bcf6f240-7a68-4c3e-a7f5-faf2133f7933","Type":"ContainerStarted","Data":"b6a1cf7e9cd1d36cbaca1f3effffd7586159471b55b37a3c96304321cde451aa"}
Sep 16 21:59:49.288732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.288664    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 21:59:49.288732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.288693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m" event={"ID":"bcf6f240-7a68-4c3e-a7f5-faf2133f7933","Type":"ContainerStarted","Data":"7c441a24c42653aeb222fae1ffd5d08f5966c296b0bf1132616e66a261c1f581"}
Sep 16 21:59:49.290429 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.290403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" event={"ID":"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac","Type":"ContainerStarted","Data":"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"}
Sep 16 21:59:49.290521 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.290439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" event={"ID":"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac","Type":"ContainerStarted","Data":"a128b38107a66a836d6c25a4e09b07bd99dcff207dd3a3e307047b349e318dab"}
Sep 16 21:59:49.290521 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.290472    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 21:59:49.293001 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.292981    2580 scope.go:117] "RemoveContainer" containerID="72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081"
Sep 16 21:59:49.293258 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:49.293239    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081\": container with ID starting with 72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081 not found: ID does not exist" containerID="72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081"
Sep 16 21:59:49.293301 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.293264    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081"} err="failed to get container status \"72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081\": rpc error: code = NotFound desc = could not find container \"72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081\": container with ID starting with 72db00dcdd27ff4834efb896897da6c2cd09ba83f7e6630c5c61c331a190a081 not found: ID does not exist"
Sep 16 21:59:49.293301 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.293280    2580 scope.go:117] "RemoveContainer" containerID="cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7"
Sep 16 21:59:49.300282 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.300263    2580 scope.go:117] "RemoveContainer" containerID="cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7"
Sep 16 21:59:49.300526 ip-10-0-129-128 kubenswrapper[2580]: E0916 21:59:49.300507    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7\": container with ID starting with cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7 not found: ID does not exist" containerID="cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7"
Sep 16 21:59:49.300596 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.300532    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7"} err="failed to get container status \"cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7\": rpc error: code = NotFound desc = could not find container \"cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7\": container with ID starting with cc38fb99e705cb8aa65c98ab6f410a5038f4c129d97baa1904400e9ad82e58f7 not found: ID does not exist"
Sep 16 21:59:49.325839 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.325793    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m" podStartSLOduration=1.3257794139999999 podStartE2EDuration="1.325779414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:49.324533529 +0000 UTC m=+669.000722010" watchObservedRunningTime="2026-09-16 21:59:49.325779414 +0000 UTC m=+669.001967893"
Sep 16 21:59:49.380426 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.380342    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" podStartSLOduration=1.380328392 podStartE2EDuration="1.380328392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:49.377713921 +0000 UTC m=+669.053902400" watchObservedRunningTime="2026-09-16 21:59:49.380328392 +0000 UTC m=+669.056516871"
Sep 16 21:59:49.386865 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:49.386837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"]
Sep 16 21:59:49.388922 ip-10-0-129-128 kubenswrapper[2580]: W0916 21:59:49.388899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5156c7_1467_41f1_ada6_617826dbcd2f.slice/crio-b5802f6b657572215e1deb59b6f40926a792c25c0cdef63d0000c8d0450c8ed5 WatchSource:0}: Error finding container b5802f6b657572215e1deb59b6f40926a792c25c0cdef63d0000c8d0450c8ed5: Status 404 returned error can't find the container with id b5802f6b657572215e1deb59b6f40926a792c25c0cdef63d0000c8d0450c8ed5
Sep 16 21:59:50.300259 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:50.300225    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7" event={"ID":"3f5156c7-1467-41f1-ada6-617826dbcd2f","Type":"ContainerStarted","Data":"a8fd4d99a3b2d5c802bb9f127d67236ac42d4b1c9afcd6e92afc35d450646b20"}
Sep 16 21:59:50.300732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:50.300289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7" event={"ID":"3f5156c7-1467-41f1-ada6-617826dbcd2f","Type":"ContainerStarted","Data":"b5802f6b657572215e1deb59b6f40926a792c25c0cdef63d0000c8d0450c8ed5"}
Sep 16 21:59:50.300732 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:50.300320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 21:59:50.320543 ip-10-0-129-128 kubenswrapper[2580]: I0916 21:59:50.320493    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7" podStartSLOduration=2.320476641 podStartE2EDuration="2.320476641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 21:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 21:59:50.319375343 +0000 UTC m=+669.995563819" watchObservedRunningTime="2026-09-16 21:59:50.320476641 +0000 UTC m=+669.996665120"
Sep 16 22:00:00.303953 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:00.303916    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-x4f5m"
Sep 16 22:00:00.304421 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:00.304141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 22:00:01.307251 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.307221    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fb8x7"
Sep 16 22:00:01.360441 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.360412    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 22:00:01.360666 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.360598    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" podUID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" containerName="manager" containerID="cri-o://f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8" gracePeriod=10
Sep 16 22:00:01.619656 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.619603    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 22:00:01.688975 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.688945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhd5d\" (UniqueName: \"kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d\") pod \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") "
Sep 16 22:00:01.689126 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.689006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume\") pod \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\" (UID: \"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac\") "
Sep 16 22:00:01.689358 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.689336    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" (UID: "3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 22:00:01.690799 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.690762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d" (OuterVolumeSpecName: "kube-api-access-hhd5d") pod "3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" (UID: "3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac"). InnerVolumeSpecName "kube-api-access-hhd5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:01.790120 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.790094    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhd5d\" (UniqueName: \"kubernetes.io/projected/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-kube-api-access-hhd5d\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 22:00:01.790120 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:01.790119    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac-extensions-socket-volume\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 22:00:02.357748 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.357713    2580 generic.go:356] "Generic (PLEG): container finished" podID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" containerID="f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8" exitCode=0
Sep 16 22:00:02.358209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.357763    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"
Sep 16 22:00:02.358209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.357795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" event={"ID":"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac","Type":"ContainerDied","Data":"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"}
Sep 16 22:00:02.358209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.357847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx" event={"ID":"3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac","Type":"ContainerDied","Data":"a128b38107a66a836d6c25a4e09b07bd99dcff207dd3a3e307047b349e318dab"}
Sep 16 22:00:02.358209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.357869    2580 scope.go:117] "RemoveContainer" containerID="f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"
Sep 16 22:00:02.366628 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.366431    2580 scope.go:117] "RemoveContainer" containerID="f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"
Sep 16 22:00:02.366715 ip-10-0-129-128 kubenswrapper[2580]: E0916 22:00:02.366697    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8\": container with ID starting with f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8 not found: ID does not exist" containerID="f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"
Sep 16 22:00:02.366754 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.366721    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8"} err="failed to get container status \"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8\": rpc error: code = NotFound desc = could not find container \"f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8\": container with ID starting with f70b8c9104f03861f65fd8d7b50ae9f00e3a99f5a4e44168e30e9921cd8a5aa8 not found: ID does not exist"
Sep 16 22:00:02.381714 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.381694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 22:00:02.387727 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.387707    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hr8mx"]
Sep 16 22:00:02.962644 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:02.962587    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" path="/var/lib/kubelet/pods/3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac/volumes"
Sep 16 22:00:17.667703 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.667669    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"]
Sep 16 22:00:17.668062 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.667982    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" containerName="manager"
Sep 16 22:00:17.668062 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.667994    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" containerName="manager"
Sep 16 22:00:17.668062 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.668055    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6aaac1-b53a-47c7-9ec9-7d7a9ce0bbac" containerName="manager"
Sep 16 22:00:17.669953 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.669932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.672794 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.672771    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tdx2k\""
Sep 16 22:00:17.684288 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.684267    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"]
Sep 16 22:00:17.811429 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w54wt\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-kube-api-access-w54wt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.811852 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.811604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912461 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912887 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.912941 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913018 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.912997    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913095 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.913036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.913119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913209 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.913150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w54wt\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-kube-api-access-w54wt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913381 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.913324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.913451 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.913415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.915238 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.915216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.915331 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.915311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.921558 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.921504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w54wt\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-kube-api-access-w54wt\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.922053 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.922000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tgsr5\" (UID: \"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:17.980898 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:17.980875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:18.256317 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.256171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"]
Sep 16 22:00:18.258622 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:00:18.258576    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e5e954_6202_4ae1_bec8_a1b5d0a1dee8.slice/crio-26bbffdb3f458f2a0f50e08c53f55fa44c08824a9cf53df8c1107a209c7fabf7 WatchSource:0}: Error finding container 26bbffdb3f458f2a0f50e08c53f55fa44c08824a9cf53df8c1107a209c7fabf7: Status 404 returned error can't find the container with id 26bbffdb3f458f2a0f50e08c53f55fa44c08824a9cf53df8c1107a209c7fabf7
Sep 16 22:00:18.264267 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.264227    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:00:18.264362 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.264315    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:00:18.264362 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.264355    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:00:18.435645 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.435590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" event={"ID":"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8","Type":"ContainerStarted","Data":"69a0e5a8cc51885ff8165ed670638d759aa8e8899f4abb535d0785191eaa159f"}
Sep 16 22:00:18.435837 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.435677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" event={"ID":"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8","Type":"ContainerStarted","Data":"26bbffdb3f458f2a0f50e08c53f55fa44c08824a9cf53df8c1107a209c7fabf7"}
Sep 16 22:00:18.455546 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.455497    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podStartSLOduration=1.455483353 podStartE2EDuration="1.455483353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:18.454391678 +0000 UTC m=+698.130580157" watchObservedRunningTime="2026-09-16 22:00:18.455483353 +0000 UTC m=+698.131671830"
Sep 16 22:00:18.981773 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:18.981740    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:19.631645 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.631591    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:00:19.634510 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.634486    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.637278 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.637253    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 22:00:19.637278 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.637253    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfr57\""
Sep 16 22:00:19.643837 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.643813    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:00:19.670649 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.669234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:00:19.727016 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.726961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83a457de-6737-47f3-8e7c-b9f71754c090-config-file\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.727186 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.727103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x9cq\" (UniqueName: \"kubernetes.io/projected/83a457de-6737-47f3-8e7c-b9f71754c090-kube-api-access-9x9cq\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.827876 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.827834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83a457de-6737-47f3-8e7c-b9f71754c090-config-file\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.828054 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.827908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x9cq\" (UniqueName: \"kubernetes.io/projected/83a457de-6737-47f3-8e7c-b9f71754c090-kube-api-access-9x9cq\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.828640 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.828588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83a457de-6737-47f3-8e7c-b9f71754c090-config-file\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.835365 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.835333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x9cq\" (UniqueName: \"kubernetes.io/projected/83a457de-6737-47f3-8e7c-b9f71754c090-kube-api-access-9x9cq\") pod \"limitador-limitador-84994f7ffc-sgzxs\" (UID: \"83a457de-6737-47f3-8e7c-b9f71754c090\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.946390 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.946313    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:19.986802 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:19.986773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:20.218914 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.218845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:00:20.221687 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:00:20.221664    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a457de_6737_47f3_8e7c_b9f71754c090.slice/crio-0b7c43bde3154e30b9092b7ceda54913ec90bc04636687d8dad02dd1d350fa4c WatchSource:0}: Error finding container 0b7c43bde3154e30b9092b7ceda54913ec90bc04636687d8dad02dd1d350fa4c: Status 404 returned error can't find the container with id 0b7c43bde3154e30b9092b7ceda54913ec90bc04636687d8dad02dd1d350fa4c
Sep 16 22:00:20.342625 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.342575    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:20.345574 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.345547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:20.348212 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.348194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ktrm\""
Sep 16 22:00:20.352795 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.352770    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:20.432525 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.432491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzfg\" (UniqueName: \"kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg\") pod \"authorino-59c974bd48-b2gh2\" (UID: \"920904e1-61a0-4031-ba09-8203a9d0f2a5\") " pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:20.444648 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.444623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs" event={"ID":"83a457de-6737-47f3-8e7c-b9f71754c090","Type":"ContainerStarted","Data":"0b7c43bde3154e30b9092b7ceda54913ec90bc04636687d8dad02dd1d350fa4c"}
Sep 16 22:00:20.444880 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.444864    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:20.445672 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.445654    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:00:20.533507 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.533475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzfg\" (UniqueName: \"kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg\") pod \"authorino-59c974bd48-b2gh2\" (UID: \"920904e1-61a0-4031-ba09-8203a9d0f2a5\") " pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:20.541019 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.541000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzfg\" (UniqueName: \"kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg\") pod \"authorino-59c974bd48-b2gh2\" (UID: \"920904e1-61a0-4031-ba09-8203a9d0f2a5\") " pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:20.655886 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.655858    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:20.923060 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:20.922977    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:20.925199 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:00:20.925171    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod920904e1_61a0_4031_ba09_8203a9d0f2a5.slice/crio-c87082e0b1edc41eff81c5fa7fa21461932e2806ff77308618c51b44e74cabf1 WatchSource:0}: Error finding container c87082e0b1edc41eff81c5fa7fa21461932e2806ff77308618c51b44e74cabf1: Status 404 returned error can't find the container with id c87082e0b1edc41eff81c5fa7fa21461932e2806ff77308618c51b44e74cabf1
Sep 16 22:00:21.450674 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:21.450641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b2gh2" event={"ID":"920904e1-61a0-4031-ba09-8203a9d0f2a5","Type":"ContainerStarted","Data":"c87082e0b1edc41eff81c5fa7fa21461932e2806ff77308618c51b44e74cabf1"}
Sep 16 22:00:22.456951 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:22.456913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs" event={"ID":"83a457de-6737-47f3-8e7c-b9f71754c090","Type":"ContainerStarted","Data":"09f760e93bff112f16a4f23a232b28652053384b572d521e41546bbd6bf6f817"}
Sep 16 22:00:22.457380 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:22.457058    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:22.473485 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:22.473439    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs" podStartSLOduration=2.234993106 podStartE2EDuration="3.473424238s" totalImagesPullingTime="1.238431132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:22.471672455 +0000 UTC m=+702.147860933" watchObservedRunningTime="2026-09-16 22:00:22.473424238 +0000 UTC m=+702.149612715"
Sep 16 22:00:26.479051 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:26.478951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b2gh2" event={"ID":"920904e1-61a0-4031-ba09-8203a9d0f2a5","Type":"ContainerStarted","Data":"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"}
Sep 16 22:00:26.493324 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:26.493274    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-b2gh2" podStartSLOduration=1.21856581 podStartE2EDuration="6.493258549s" totalImagesPullingTime="5.274692739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:00:26.492328196 +0000 UTC m=+706.168516688" watchObservedRunningTime="2026-09-16 22:00:26.493258549 +0000 UTC m=+706.169447026"
Sep 16 22:00:33.462344 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:33.462262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"
Sep 16 22:00:55.685921 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:55.685890    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:55.686415 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:55.686059    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-b2gh2" podUID="920904e1-61a0-4031-ba09-8203a9d0f2a5" containerName="authorino" containerID="cri-o://cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f" gracePeriod=30
Sep 16 22:00:55.933912 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:55.933889    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:56.013700 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.013672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzfg\" (UniqueName: \"kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg\") pod \"920904e1-61a0-4031-ba09-8203a9d0f2a5\" (UID: \"920904e1-61a0-4031-ba09-8203a9d0f2a5\") "
Sep 16 22:00:56.015562 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.015534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg" (OuterVolumeSpecName: "kube-api-access-drzfg") pod "920904e1-61a0-4031-ba09-8203a9d0f2a5" (UID: "920904e1-61a0-4031-ba09-8203a9d0f2a5"). InnerVolumeSpecName "kube-api-access-drzfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 22:00:56.114321 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.114292    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzfg\" (UniqueName: \"kubernetes.io/projected/920904e1-61a0-4031-ba09-8203a9d0f2a5-kube-api-access-drzfg\") on node \"ip-10-0-129-128.ec2.internal\" DevicePath \"\""
Sep 16 22:00:56.619198 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.619164    2580 generic.go:356] "Generic (PLEG): container finished" podID="920904e1-61a0-4031-ba09-8203a9d0f2a5" containerID="cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f" exitCode=0
Sep 16 22:00:56.619371 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.619206    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b2gh2"
Sep 16 22:00:56.619371 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.619267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b2gh2" event={"ID":"920904e1-61a0-4031-ba09-8203a9d0f2a5","Type":"ContainerDied","Data":"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"}
Sep 16 22:00:56.619371 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.619316    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b2gh2" event={"ID":"920904e1-61a0-4031-ba09-8203a9d0f2a5","Type":"ContainerDied","Data":"c87082e0b1edc41eff81c5fa7fa21461932e2806ff77308618c51b44e74cabf1"}
Sep 16 22:00:56.619371 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.619334    2580 scope.go:117] "RemoveContainer" containerID="cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"
Sep 16 22:00:56.628960 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.628940    2580 scope.go:117] "RemoveContainer" containerID="cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"
Sep 16 22:00:56.629299 ip-10-0-129-128 kubenswrapper[2580]: E0916 22:00:56.629265    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f\": container with ID starting with cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f not found: ID does not exist" containerID="cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"
Sep 16 22:00:56.629357 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.629309    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f"} err="failed to get container status \"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f\": rpc error: code = NotFound desc = could not find container \"cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f\": container with ID starting with cf1b578de9a0fd48df35170ae47b88c2f4c40940fd9652e95a7694b4b4b8a77f not found: ID does not exist"
Sep 16 22:00:56.641004 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.640978    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:56.645055 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.645035    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b2gh2"]
Sep 16 22:00:56.958433 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:00:56.958362    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="920904e1-61a0-4031-ba09-8203a9d0f2a5" path="/var/lib/kubelet/pods/920904e1-61a0-4031-ba09-8203a9d0f2a5/volumes"
Sep 16 22:01:36.928624 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:36.928584    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:01:46.840879 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.840843    2580 generic.go:356] "Generic (PLEG): container finished" podID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerID="69a0e5a8cc51885ff8165ed670638d759aa8e8899f4abb535d0785191eaa159f" exitCode=0
Sep 16 22:01:46.841290 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.840918    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" event={"ID":"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8","Type":"ContainerDied","Data":"69a0e5a8cc51885ff8165ed670638d759aa8e8899f4abb535d0785191eaa159f"}
Sep 16 22:01:46.841331 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.841305    2580 scope.go:117] "RemoveContainer" containerID="69a0e5a8cc51885ff8165ed670638d759aa8e8899f4abb535d0785191eaa159f"
Sep 16 22:01:46.842307 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.842277    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:01:46.842419 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.842362    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:01:46.842419 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:46.842410    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 16 22:01:47.850419 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:47.850378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" event={"ID":"d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8","Type":"ContainerStarted","Data":"83440643ba24adacee12d8c458d94dd9c56960188deaa005245137017bbb76f0"}
Sep 16 22:01:47.981050 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:47.981014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:01:47.982180 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:47.982159    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tgsr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 16 22:01:47.982243 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:47.982212    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podUID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 16 22:01:48.981730 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:48.981693    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tgsr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 16 22:01:48.982191 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:48.981760    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podUID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 16 22:01:49.982178 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:49.982136    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tgsr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 16 22:01:49.982684 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:49.982226    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podUID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 16 22:01:50.444905 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:50.444814    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:01:50.981559 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:50.981520    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tgsr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 16 22:01:50.981762 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:50.981573    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podUID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 16 22:01:51.981516 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:51.981480    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tgsr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 16 22:01:51.981910 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:51.981548    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5" podUID="d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 16 22:01:52.984913 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:52.984883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:01:52.985792 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:01:52.985773    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tgsr5"
Sep 16 22:02:01.671020 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:01.670986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:08.973108 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:08.973019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:20.482596 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.482500    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"]
Sep 16 22:02:20.483077 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.483052    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="920904e1-61a0-4031-ba09-8203a9d0f2a5" containerName="authorino"
Sep 16 22:02:20.483077 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.483076    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="920904e1-61a0-4031-ba09-8203a9d0f2a5" containerName="authorino"
Sep 16 22:02:20.483184 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.483162    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="920904e1-61a0-4031-ba09-8203a9d0f2a5" containerName="authorino"
Sep 16 22:02:20.486655 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.486632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.489394 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.489371    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 22:02:20.490469 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.490443    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 22:02:20.490594 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.490563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qf59f\""
Sep 16 22:02:20.490594 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.490563    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 22:02:20.494369 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.494346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"]
Sep 16 22:02:20.595101 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.595101 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjhr\" (UniqueName: \"kubernetes.io/projected/8c94403d-1224-40ea-b2d8-8ef19e80e399-kube-api-access-zjjhr\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.595350 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c94403d-1224-40ea-b2d8-8ef19e80e399-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.595350 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.595350 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.595350 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.595302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696198 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696198 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjhr\" (UniqueName: \"kubernetes.io/projected/8c94403d-1224-40ea-b2d8-8ef19e80e399-kube-api-access-zjjhr\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696438 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c94403d-1224-40ea-b2d8-8ef19e80e399-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696438 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696438 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696438 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696681 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696757 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.696814 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.696787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.698591 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.698564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c94403d-1224-40ea-b2d8-8ef19e80e399-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.698718 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.698690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c94403d-1224-40ea-b2d8-8ef19e80e399-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.704123 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.704105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjhr\" (UniqueName: \"kubernetes.io/projected/8c94403d-1224-40ea-b2d8-8ef19e80e399-kube-api-access-zjjhr\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2\" (UID: \"8c94403d-1224-40ea-b2d8-8ef19e80e399\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:20.800096 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:20.799999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:21.069834 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:21.069808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"]
Sep 16 22:02:21.071870 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:02:21.071831    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c94403d_1224_40ea_b2d8_8ef19e80e399.slice/crio-612c74dc6937991779314110d4ade338ab8e8fb895d7985b748c7725055510f7 WatchSource:0}: Error finding container 612c74dc6937991779314110d4ade338ab8e8fb895d7985b748c7725055510f7: Status 404 returned error can't find the container with id 612c74dc6937991779314110d4ade338ab8e8fb895d7985b748c7725055510f7
Sep 16 22:02:21.579915 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:21.579878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:22.009312 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:22.009218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2" event={"ID":"8c94403d-1224-40ea-b2d8-8ef19e80e399","Type":"ContainerStarted","Data":"612c74dc6937991779314110d4ade338ab8e8fb895d7985b748c7725055510f7"}
Sep 16 22:02:23.015384 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:23.015345    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2" event={"ID":"8c94403d-1224-40ea-b2d8-8ef19e80e399","Type":"ContainerStarted","Data":"a3a103f26cd9e2dbeb249ec4b06b1a17fb8495d302427b03cb7ae106c80d15e4"}
Sep 16 22:02:23.034699 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:23.034647    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2" podStartSLOduration=2.040518257 podStartE2EDuration="3.034629642s" totalImagesPullingTime="994.111385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:23.032283481 +0000 UTC m=+822.708471959" watchObservedRunningTime="2026-09-16 22:02:23.034629642 +0000 UTC m=+822.710818116"
Sep 16 22:02:29.676553 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:29.676515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:30.801152 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:30.801095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:30.801558 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:30.801179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:30.813655 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:30.813622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:31.064260 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:31.064175    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8z2v2"
Sep 16 22:02:48.585279 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.585241    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"]
Sep 16 22:02:48.588771 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.588742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.591403 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.591379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 16 22:02:48.597725 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.597701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"]
Sep 16 22:02:48.621462 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.621685 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.621685 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.621685 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.621826 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f77gz\" (UniqueName: \"kubernetes.io/projected/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-kube-api-access-f77gz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.621826 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.621753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.722986 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.722933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.722986 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.722989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723221 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f77gz\" (UniqueName: \"kubernetes.io/projected/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-kube-api-access-f77gz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723221 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723221 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723221 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723425 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723481 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.723682 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.723663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.725830 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.725801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.725931 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.725843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.731861 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.731836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f77gz\" (UniqueName: \"kubernetes.io/projected/9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f-kube-api-access-f77gz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f\" (UID: \"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:48.901756 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:48.901674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:49.174063 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:49.174015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"]
Sep 16 22:02:49.176339 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:02:49.176310    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0b990e_dee4_4a79_ade6_a7f7f49e5a1f.slice/crio-099fcfdf43263795d4dc1a2ab12673dcfc829d76b3ef24067255bb31f610897a WatchSource:0}: Error finding container 099fcfdf43263795d4dc1a2ab12673dcfc829d76b3ef24067255bb31f610897a: Status 404 returned error can't find the container with id 099fcfdf43263795d4dc1a2ab12673dcfc829d76b3ef24067255bb31f610897a
Sep 16 22:02:50.140635 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:50.140577    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f" event={"ID":"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f","Type":"ContainerStarted","Data":"27701a2a667436f4bac054cce0011460e1904d88cf43e176e3cd74ce324012e6"}
Sep 16 22:02:50.141129 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:50.140697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f" event={"ID":"9c0b990e-dee4-4a79-ade6-a7f7f49e5a1f","Type":"ContainerStarted","Data":"099fcfdf43263795d4dc1a2ab12673dcfc829d76b3ef24067255bb31f610897a"}
Sep 16 22:02:50.159750 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:50.159701    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f" podStartSLOduration=1.9635824610000001 podStartE2EDuration="2.159687083s" totalImagesPullingTime="196.104622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:02:50.158935568 +0000 UTC m=+849.835124047" watchObservedRunningTime="2026-09-16 22:02:50.159687083 +0000 UTC m=+849.835875560"
Sep 16 22:02:50.273959 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:50.273927    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:57.873388 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:57.873352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:02:58.902248 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:58.902215    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:58.902652 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:58.902275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:58.914884 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:58.914856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:02:59.194151 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:02:59.194064    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjmk8f"
Sep 16 22:03:07.574432 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.574389    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"]
Sep 16 22:03:07.578277 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.578256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.580811 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.580788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 16 22:03:07.589126 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.589103    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"]
Sep 16 22:03:07.684879 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.684840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrfgg\" (UniqueName: \"kubernetes.io/projected/7f4d2239-06a5-4441-9279-47546cd55c9f-kube-api-access-hrfgg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.684879 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.684881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.685093 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.684905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.685093 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.685008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.685093 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.685040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.685211 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.685094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d2239-06a5-4441-9279-47546cd55c9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786007 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.785972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d2239-06a5-4441-9279-47546cd55c9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786187 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrfgg\" (UniqueName: \"kubernetes.io/projected/7f4d2239-06a5-4441-9279-47546cd55c9f-kube-api-access-hrfgg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786187 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786187 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786187 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786187 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786517 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786649 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.786649 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.786641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.788464 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.788442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f4d2239-06a5-4441-9279-47546cd55c9f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.788635 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.788598    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f4d2239-06a5-4441-9279-47546cd55c9f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.794984 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.794958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrfgg\" (UniqueName: \"kubernetes.io/projected/7f4d2239-06a5-4441-9279-47546cd55c9f-kube-api-access-hrfgg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d\" (UID: \"7f4d2239-06a5-4441-9279-47546cd55c9f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:07.890119 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:07.890032    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:08.160046 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:08.160014    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"]
Sep 16 22:03:08.161580 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:03:08.161546    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f4d2239_06a5_4441_9279_47546cd55c9f.slice/crio-147a15d9442a492a634ff700d1622c1cfa496a2a0f69278c3ee2932a555accf8 WatchSource:0}: Error finding container 147a15d9442a492a634ff700d1622c1cfa496a2a0f69278c3ee2932a555accf8: Status 404 returned error can't find the container with id 147a15d9442a492a634ff700d1622c1cfa496a2a0f69278c3ee2932a555accf8
Sep 16 22:03:08.225035 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:08.224997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d" event={"ID":"7f4d2239-06a5-4441-9279-47546cd55c9f","Type":"ContainerStarted","Data":"147a15d9442a492a634ff700d1622c1cfa496a2a0f69278c3ee2932a555accf8"}
Sep 16 22:03:09.233383 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:09.233348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d" event={"ID":"7f4d2239-06a5-4441-9279-47546cd55c9f","Type":"ContainerStarted","Data":"c5b3cb2e7b132e0a3e313559ef499d61396687e23790095f349ec55473ce30c5"}
Sep 16 22:03:09.251641 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:09.251569    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d" podStartSLOduration=2.074920185 podStartE2EDuration="2.251550484s" totalImagesPullingTime="176.630299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:03:09.2504467 +0000 UTC m=+868.926635180" watchObservedRunningTime="2026-09-16 22:03:09.251550484 +0000 UTC m=+868.927739001"
Sep 16 22:03:09.783296 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:09.783260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-sgzxs"]
Sep 16 22:03:17.890433 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:17.890390    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:17.890433 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:17.890445    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:17.902822 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:17.902799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:03:18.286562 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:03:18.286533    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jfj7d"
Sep 16 22:04:26.624239 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.624201    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6fbbd677b9-8pc5b"]
Sep 16 22:04:26.631970 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.631942    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.635410 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.635189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ktrm\""
Sep 16 22:04:26.636813 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.636409    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 16 22:04:26.637660 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.637634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fbbd677b9-8pc5b"]
Sep 16 22:04:26.687210 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.687176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4deaa6a-ccdc-4501-852a-4813c604e7b8-tls-cert\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.687369 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.687253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bw9\" (UniqueName: \"kubernetes.io/projected/e4deaa6a-ccdc-4501-852a-4813c604e7b8-kube-api-access-86bw9\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.788247 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.788208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4deaa6a-ccdc-4501-852a-4813c604e7b8-tls-cert\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.788417 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.788304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bw9\" (UniqueName: \"kubernetes.io/projected/e4deaa6a-ccdc-4501-852a-4813c604e7b8-kube-api-access-86bw9\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.790854 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.790826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e4deaa6a-ccdc-4501-852a-4813c604e7b8-tls-cert\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.795569 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.795544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bw9\" (UniqueName: \"kubernetes.io/projected/e4deaa6a-ccdc-4501-852a-4813c604e7b8-kube-api-access-86bw9\") pod \"authorino-6fbbd677b9-8pc5b\" (UID: \"e4deaa6a-ccdc-4501-852a-4813c604e7b8\") " pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:26.942761 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:26.942678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6fbbd677b9-8pc5b"
Sep 16 22:04:27.210297 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:27.210217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6fbbd677b9-8pc5b"]
Sep 16 22:04:27.213681 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:04:27.213654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4deaa6a_ccdc_4501_852a_4813c604e7b8.slice/crio-9bfca0d310bb5245333918ca6b8507f36993b77e5111f0cf85c290bbe5e4b0c9 WatchSource:0}: Error finding container 9bfca0d310bb5245333918ca6b8507f36993b77e5111f0cf85c290bbe5e4b0c9: Status 404 returned error can't find the container with id 9bfca0d310bb5245333918ca6b8507f36993b77e5111f0cf85c290bbe5e4b0c9
Sep 16 22:04:27.582534 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:27.582499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbbd677b9-8pc5b" event={"ID":"e4deaa6a-ccdc-4501-852a-4813c604e7b8","Type":"ContainerStarted","Data":"9bfca0d310bb5245333918ca6b8507f36993b77e5111f0cf85c290bbe5e4b0c9"}
Sep 16 22:04:28.589111 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:28.589064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6fbbd677b9-8pc5b" event={"ID":"e4deaa6a-ccdc-4501-852a-4813c604e7b8","Type":"ContainerStarted","Data":"9d909b62876aade90a76028157a1df1bc4a4fa57fff4073395bd7dc22d23cf85"}
Sep 16 22:04:28.608511 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:04:28.608461    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6fbbd677b9-8pc5b" podStartSLOduration=1.8491695670000001 podStartE2EDuration="2.60844407s" totalImagesPullingTime="759.274503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 22:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:04:28.606243499 +0000 UTC m=+948.282431977" watchObservedRunningTime="2026-09-16 22:04:28.60844407 +0000 UTC m=+948.284632550"
Sep 16 22:08:34.720712 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:34.720620    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9f8411d-64b5-4183-a873-a0182c13480e" containerID="27cecf25d8f7b4398e6f2249bc6a5740671d28c72aacb5efc194d03e81c51016" exitCode=1
Sep 16 22:08:34.720712 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:34.720670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv" event={"ID":"b9f8411d-64b5-4183-a873-a0182c13480e","Type":"ContainerDied","Data":"27cecf25d8f7b4398e6f2249bc6a5740671d28c72aacb5efc194d03e81c51016"}
Sep 16 22:08:34.721261 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:34.721047    2580 scope.go:117] "RemoveContainer" containerID="27cecf25d8f7b4398e6f2249bc6a5740671d28c72aacb5efc194d03e81c51016"
Sep 16 22:08:34.721433 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:34.721415    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 22:08:35.728491 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:35.728395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv" event={"ID":"b9f8411d-64b5-4183-a873-a0182c13480e","Type":"ContainerStarted","Data":"00128261e7581603b92314d4b432be2a16afba8b82bf1f45f97e9ec368f04e91"}
Sep 16 22:08:35.728979 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:08:35.728633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 22:09:06.734523 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:09:06.734490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s5kgv"
Sep 16 22:14:21.211178 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:21.211097    2580 ???:1] "http: TLS handshake error from 10.0.129.128:55422: EOF"
Sep 16 22:14:21.217134 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:21.217111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g8bwq_c43b2736-e9b7-4461-97fe-c42c066e1770/global-pull-secret-syncer/0.log"
Sep 16 22:14:21.373654 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:21.373624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w9hp6_ed852582-836e-41d9-99c7-050a18dde47d/konnectivity-agent/0.log"
Sep 16 22:14:21.392289 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:21.392254    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-128.ec2.internal_4beacb691c0810bb4c0ae6ade1dd54cb/haproxy/0.log"
Sep 16 22:14:26.081704 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.081668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6fbbd677b9-8pc5b_e4deaa6a-ccdc-4501-852a-4813c604e7b8/authorino/0.log"
Sep 16 22:14:26.149247 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.149219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-5j6ln_bd118c84-342f-42f1-b287-5fa9c4dac4da/manager/0.log"
Sep 16 22:14:26.172995 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.172958    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kvhc4_e91a922a-7632-420e-83d4-29ab5a530aad/manager/0.log"
Sep 16 22:14:26.239218 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.239187    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fb8x7_3f5156c7-1467-41f1-ada6-617826dbcd2f/manager/0.log"
Sep 16 22:14:26.263376 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.263349    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-sgzxs_83a457de-6737-47f3-8e7c-b9f71754c090/limitador/0.log"
Sep 16 22:14:26.294045 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:26.294012    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-x4f5m_bcf6f240-7a68-4c3e-a7f5-faf2133f7933/manager/0.log"
Sep 16 22:14:28.166595 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:28.166562    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/node-exporter/0.log"
Sep 16 22:14:28.191030 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:28.190986    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/kube-rbac-proxy/0.log"
Sep 16 22:14:28.210192 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:28.210171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxgvs_c3ebbb3e-9c57-4a26-b24f-2d4df5a92c0f/init-textfile/0.log"
Sep 16 22:14:30.271046 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:30.271006    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-jwtr7_e38d80f6-8188-444b-87d8-12400e878beb/networking-console-plugin/0.log"
Sep 16 22:14:31.377535 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.377501    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"]
Sep 16 22:14:31.380782 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.380760    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.383455 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.383434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sk4xn\"/\"default-dockercfg-tqklh\""
Sep 16 22:14:31.383560 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.383432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"openshift-service-ca.crt\""
Sep 16 22:14:31.384369 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.384352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sk4xn\"/\"kube-root-ca.crt\""
Sep 16 22:14:31.388307 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.387858    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"]
Sep 16 22:14:31.527756 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.527719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-sys\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.527965 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.527774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-lib-modules\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.527965 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.527811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r989s\" (UniqueName: \"kubernetes.io/projected/fe7b1ac9-f68d-4d35-a328-71d4083787f7-kube-api-access-r989s\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.527965 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.527840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-podres\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.527965 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.527950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-proc\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.628817 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r989s\" (UniqueName: \"kubernetes.io/projected/fe7b1ac9-f68d-4d35-a328-71d4083787f7-kube-api-access-r989s\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.628817 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628775    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-podres\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.628817 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-proc\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-sys\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-lib-modules\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-sys\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-podres\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-proc\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.629074 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.628977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fe7b1ac9-f68d-4d35-a328-71d4083787f7-lib-modules\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.636274 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.636247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r989s\" (UniqueName: \"kubernetes.io/projected/fe7b1ac9-f68d-4d35-a328-71d4083787f7-kube-api-access-r989s\") pod \"perf-node-gather-daemonset-4whxl\" (UID: \"fe7b1ac9-f68d-4d35-a328-71d4083787f7\") " pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.691523 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.691484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:31.961136 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:31.961114    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"]
Sep 16 22:14:31.963267 ip-10-0-129-128 kubenswrapper[2580]: W0916 22:14:31.963236    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfe7b1ac9_f68d_4d35_a328_71d4083787f7.slice/crio-599d7cddb1ca08f2194c1e4d1c4b3e769b39dbcc684b64cad0a9b28ea8ebaf88 WatchSource:0}: Error finding container 599d7cddb1ca08f2194c1e4d1c4b3e769b39dbcc684b64cad0a9b28ea8ebaf88: Status 404 returned error can't find the container with id 599d7cddb1ca08f2194c1e4d1c4b3e769b39dbcc684b64cad0a9b28ea8ebaf88
Sep 16 22:14:32.389035 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:32.388999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl" event={"ID":"fe7b1ac9-f68d-4d35-a328-71d4083787f7","Type":"ContainerStarted","Data":"af21907a6c7e4fc0ae8159acdfe37ff0d63116332ad26cbab4533fb73f3feacb"}
Sep 16 22:14:32.389514 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:32.389048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl" event={"ID":"fe7b1ac9-f68d-4d35-a328-71d4083787f7","Type":"ContainerStarted","Data":"599d7cddb1ca08f2194c1e4d1c4b3e769b39dbcc684b64cad0a9b28ea8ebaf88"}
Sep 16 22:14:32.389514 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:32.389139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:33.165712 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:33.165683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckn8r_836f2c51-421f-4e35-a71a-52285c687c0d/dns/0.log"
Sep 16 22:14:33.188496 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:33.188467    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckn8r_836f2c51-421f-4e35-a71a-52285c687c0d/kube-rbac-proxy/0.log"
Sep 16 22:14:33.314077 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:33.314047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd2w7_faed1203-1b10-4f5b-bfbd-83eaaaa218e8/dns-node-resolver/0.log"
Sep 16 22:14:33.892632 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:33.892581    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jhjbv_295d2cae-f99d-4964-aa75-622967559cfb/node-ca/0.log"
Sep 16 22:14:34.792733 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:34.792700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl_f612e233-d4c3-4eb8-b325-0c03831e5ede/istio-proxy/0.log"
Sep 16 22:14:34.897259 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:34.897228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-x9cln_58994cd8-a66d-4b39-ac3b-c4d88e44af87/kube-auth-proxy/0.log"
Sep 16 22:14:34.957077 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:34.957042    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/1.log"
Sep 16 22:14:34.957556 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:34.957526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/0.log"
Sep 16 22:14:35.654671 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:35.654636    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-56lvz_2843ebf3-37d7-4a8b-beff-25d3806f27dd/serve-healthcheck-canary/0.log"
Sep 16 22:14:36.337828 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:36.337798    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vms_a5292d06-2da9-4fc2-a2e2-16a8c0d228c4/kube-rbac-proxy/0.log"
Sep 16 22:14:36.360089 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:36.360056    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vms_a5292d06-2da9-4fc2-a2e2-16a8c0d228c4/exporter/0.log"
Sep 16 22:14:36.379964 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:36.379933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5vms_a5292d06-2da9-4fc2-a2e2-16a8c0d228c4/extractor/0.log"
Sep 16 22:14:38.404090 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.404061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl"
Sep 16 22:14:38.420174 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.420126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sk4xn/perf-node-gather-daemonset-4whxl" podStartSLOduration=7.42011199 podStartE2EDuration="7.42011199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 22:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 22:14:32.404883049 +0000 UTC m=+1552.081071522" watchObservedRunningTime="2026-09-16 22:14:38.42011199 +0000 UTC m=+1558.096300469"
Sep 16 22:14:38.452185 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.452156    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wchdd_6caf64d8-7d5b-48da-8ab5-6e49bff08399/manager/0.log"
Sep 16 22:14:38.483565 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.483524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s5kgv_b9f8411d-64b5-4183-a873-a0182c13480e/manager/1.log"
Sep 16 22:14:38.495673 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.495631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s5kgv_b9f8411d-64b5-4183-a873-a0182c13480e/manager/0.log"
Sep 16 22:14:38.603800 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.603767    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2nt6s_1bb95b52-f610-4436-95f4-63e5f680b772/manager/0.log"
Sep 16 22:14:38.675398 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.675286    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-dzk22_aa0b8bbe-179d-4975-b336-362cd14b2df9/manager/0.log"
Sep 16 22:14:38.692560 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:38.692538    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8655b7f9cc-dzk22_aa0b8bbe-179d-4975-b336-362cd14b2df9/copy-manifests/0.log"
Sep 16 22:14:41.923617 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:41.923578    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl_f612e233-d4c3-4eb8-b325-0c03831e5ede/istio-proxy/0.log"
Sep 16 22:14:42.007247 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:42.007213    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-x9cln_58994cd8-a66d-4b39-ac3b-c4d88e44af87/kube-auth-proxy/0.log"
Sep 16 22:14:42.024837 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:42.024801    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/1.log"
Sep 16 22:14:42.025259 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:42.025238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/0.log"
Sep 16 22:14:43.304596 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:43.304561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-q6mhl_f612e233-d4c3-4eb8-b325-0c03831e5ede/istio-proxy/0.log"
Sep 16 22:14:43.391153 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:43.391118    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c57876cd9-x9cln_58994cd8-a66d-4b39-ac3b-c4d88e44af87/kube-auth-proxy/0.log"
Sep 16 22:14:43.409540 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:43.409505    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/1.log"
Sep 16 22:14:43.409962 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:43.409925    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tgsr5_d0e5e954-6202-4ae1-bec8-a1b5d0a1dee8/istio-proxy/0.log"
Sep 16 22:14:46.856413 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.856385    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/kube-multus-additional-cni-plugins/0.log"
Sep 16 22:14:46.876749 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.876722    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/egress-router-binary-copy/0.log"
Sep 16 22:14:46.895661 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.895638    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/cni-plugins/0.log"
Sep 16 22:14:46.914856 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.914833    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/bond-cni-plugin/0.log"
Sep 16 22:14:46.933916 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.933896    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/routeoverride-cni/0.log"
Sep 16 22:14:46.956370 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.956327    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/whereabouts-cni-bincopy/0.log"
Sep 16 22:14:46.978326 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:46.978296    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mbcb6_b63a5289-64ed-4b53-b249-a72818c21dfc/whereabouts-cni/0.log"
Sep 16 22:14:47.180670 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:47.180545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mx9ts_6d647fe9-0235-4dac-b22f-469fa378e6a3/kube-multus/0.log"
Sep 16 22:14:47.279827 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:47.279788    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h9wtn_82bad579-3540-4c3e-af21-67edf91dbf8d/network-metrics-daemon/0.log"
Sep 16 22:14:47.297452 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:47.297426    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h9wtn_82bad579-3540-4c3e-af21-67edf91dbf8d/kube-rbac-proxy/0.log"
Sep 16 22:14:48.337827 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.337797    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/ovn-controller/0.log"
Sep 16 22:14:48.353290 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.353247    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/ovn-acl-logging/0.log"
Sep 16 22:14:48.384204 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.384172    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/kube-rbac-proxy-node/0.log"
Sep 16 22:14:48.427334 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.427303    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/kube-rbac-proxy-ovn-metrics/0.log"
Sep 16 22:14:48.443633 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.443596    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/northd/0.log"
Sep 16 22:14:48.462683 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.462658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/nbdb/0.log"
Sep 16 22:14:48.481862 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.481836    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/sbdb/0.log"
Sep 16 22:14:48.534546 ip-10-0-129-128 kubenswrapper[2580]: I0916 22:14:48.534520    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k8n4z_42eaed63-8030-4248-aa8a-ec43dff35f21/ovnkube-controller/0.log"