Sep 09 23:06:41.302413 ip-10-0-138-84 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 23:06:41.616712 ip-10-0-138-84 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:06:41.616712 ip-10-0-138-84 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 23:06:41.616712 ip-10-0-138-84 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:06:41.616712 ip-10-0-138-84 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 23:06:41.616712 ip-10-0-138-84 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:06:41.618447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.618375    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 23:06:41.622001 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.621987    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.622001 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622001    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622004    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622007    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622010    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622013    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622017    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622020    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622023    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622026    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622029    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622031    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622034    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622037    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622043    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622046    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622049    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622051    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622054    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622057    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.622064 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622061    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622065    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622068    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622071    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622074    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622077    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622080    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622083    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622086    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622088    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622091    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622093    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622096    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622098    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622101    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622103    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622116    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622119    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622122    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622125    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.622557 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622128    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622131    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622133    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622135    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622138    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622140    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622143    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622145    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622148    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622150    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622154    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622156    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622159    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622161    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622165    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622167    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622170    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622173    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622175    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622178    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.623020 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622182    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622185    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622188    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622191    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622194    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622196    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622199    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622202    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622204    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622207    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622210    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622213    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622216    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622220    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622223    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622225    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622228    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622230    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622233    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.623502 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622235    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622238    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622240    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622243    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622246    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622249    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622252    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622255    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622257    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622260    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622262    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622265    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622268    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622271    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622273    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622276    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622278    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622281    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622283    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622286    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.623950 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622952    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622959    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622962    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622966    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622970    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622973    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622976    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622979    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622981    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622984    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622986    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622989    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622992    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622994    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.622997    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623000    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623003    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623007    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623010    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.624418 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623013    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623016    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623018    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623021    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623024    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623027    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623030    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623032    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623035    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623040    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623043    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623045    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623048    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623050    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623052    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623056    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623059    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623061    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.624903 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623065    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623067    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623072    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623075    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623078    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623080    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623083    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623086    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623089    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623091    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623094    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623097    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623099    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623102    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623105    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623121    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623124    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623126    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623129    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623132    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.625364 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623135    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623138    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623140    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623143    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623146    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623148    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623151    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623153    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623156    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623159    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623162    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623164    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623167    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623169    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623172    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623175    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623177    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623179    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623182    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623184    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.625838 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623187    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623189    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623192    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623194    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623196    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623200    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623202    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623205    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623207    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623209    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623212    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623214    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623217    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623219    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623223    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623225    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623228    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623230    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623232    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623235    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.626316 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623237    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623594    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623599    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623601    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623605    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623613    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623616    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623618    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623621    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623623    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623626    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623628    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623631    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623633    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623637    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623641    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623644    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623647    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623650    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623653    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.626785 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623656    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623658    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623661    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623664    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623666    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623669    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623672    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623674    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623677    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623679    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623683    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623686    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623689    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623692    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623694    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623697    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623699    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623702    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623710    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.627251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623712    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623715    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623717    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623720    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623723    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623726    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623729    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623732    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623734    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623736    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623739    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623742    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623744    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623747    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623749    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623752    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623754    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623756    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623760    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.627680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623762    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623765    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623767    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623769    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623772    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623774    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623777    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623779    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623782    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623784    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623786    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623789    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623791    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623799    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623802    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623805    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623807    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623810    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623812    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623814    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623817    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.628136 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623819    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623822    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623824    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623827    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623829    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623832    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623834    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623837    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623839    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623841    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623844    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623846    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623849    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623851    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623854    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623856    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623859    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623861    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623864    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623866    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.628639 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.623869    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.623947    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.623988    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.623995    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624000    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624005    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624008    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624013    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624017    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624020    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624023    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624026    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624029    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624032    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624036    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624039    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624042    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624045    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624048    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624052    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624055    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624058    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624061    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624064    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 23:06:41.629100 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624067    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624070    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624073    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624076    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624079    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624082    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624084    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624087    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624090    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624094    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624097    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624100    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624102    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624105    2578 flags.go:64] FLAG: --enable-server="true"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624123    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624130    2578 flags.go:64] FLAG: --event-burst="100"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624133    2578 flags.go:64] FLAG: --event-qps="50"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624136    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624139    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624142    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624145    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624148    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624151    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624154    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624156    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 23:06:41.629671 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624159    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624162    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624165    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624168    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624170    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624173    2578 flags.go:64] FLAG: --feature-gates=""
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624177    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624179    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624182    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624185    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624188    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624191    2578 flags.go:64] FLAG: --help="false"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624193    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624196    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624199    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624202    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624207    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624210    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624213    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624216    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624219    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624222    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624230    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624233    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 23:06:41.630316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624236    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624239    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624241    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624244    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624247    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624250    2578 flags.go:64] FLAG: --lock-file=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624253    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624255    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624258    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624263    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624266    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624269    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624272    2578 flags.go:64] FLAG: --logging-format="text"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624274    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624278    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624280    2578 flags.go:64] FLAG: --manifest-url=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624283    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624287    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624290    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624293    2578 flags.go:64] FLAG: --max-pods="110"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624296    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624299    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624302    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624305    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624308    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 23:06:41.630902 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624311    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624314    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624321    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624326    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624329    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624332    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624340    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624346    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624348    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624351    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624354    2578 flags.go:64] FLAG: --port="10250"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624357    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624359    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00020d1def011fd60"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624362    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624365    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624368    2578 flags.go:64] FLAG: --register-node="true"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624371    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624374    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624377    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624379    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624382    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624385    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624388    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624391    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624393    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 23:06:41.631517 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624396    2578 flags.go:64] FLAG: --runonce="false"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624399    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624402    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624405    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624407    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624410    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624414    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624417    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624420    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624423    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624426    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624430    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624433    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624436    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624446    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624449    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624454    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624457    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624459    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624465    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624468    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624471    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624474    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624476    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624479    2578 flags.go:64] FLAG: --v="2"
Sep 09 23:06:41.632119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624483    2578 flags.go:64] FLAG: --version="false"
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624486    2578 flags.go:64] FLAG: --vmodule=""
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624490    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.624493    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624604    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624609    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624611    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624615    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624617    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624620    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624622    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624625    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624627    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624632    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624634    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624637    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624639    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624642    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624645    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624648    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.632776 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624650    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624653    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624656    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624659    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624662    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624664    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624666    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624669    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624671    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624674    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624676    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624679    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624681    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624684    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624686    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624689    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624691    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624693    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624696    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624698    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.633261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624700    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624703    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624705    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624707    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624710    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624713    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624716    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624718    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624721    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624723    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624726    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624728    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624731    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624733    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624735    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624740    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624744    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624746    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624749    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624753    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.633763 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624756    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624759    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624762    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624765    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624767    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624770    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624773    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624775    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624778    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624780    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624783    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624785    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624796    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624800    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624803    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624806    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624809    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624812    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624815    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.634249 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624817    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624820    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624823    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624825    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624828    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624830    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624833    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624835    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624838    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624841    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624843    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624846    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624848    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624851    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624853    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624857    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624859    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624862    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624864    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.634701 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624867    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624869    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624871    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624874    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.624876    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.625889    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.632489    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.632502    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.632516    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.632524    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632575    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632579    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632582    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632585    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.635171 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632588    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632591    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632593    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632596    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632598    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632601    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632603    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632606    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632610    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632614    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632617    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632619    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632622    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632625    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632628    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632630    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632633    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632635    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632638    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632640    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.635516 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632642    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632645    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632647    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632650    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632653    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632656    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632658    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632661    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632663    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632666    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632669    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632671    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632674    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632676    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632679    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632681    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632684    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632686    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632689    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632691    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.635989 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632693    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632696    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632699    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632703    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632706    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632709    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632712    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632715    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632718    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632720    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632723    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632726    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632728    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632731    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632734    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632737    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632740    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632743    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632745    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.636469 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632748    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632751    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632753    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632756    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632759    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632761    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632764    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632766    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632768    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632771    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632773    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632776    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632779    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632797    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632801    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632805    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632808    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632811    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632813    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632816    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.636943 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632818    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632822    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632824    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632827    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632830    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632834    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632836    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632839    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632842    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632844    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632847    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632850    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632853    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632855    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632858    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.637420 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632860    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.632865    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632965    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632970    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632972    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632975    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632978    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632981    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632984    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632986    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632989    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632991    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632994    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632997    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.632999    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:06:41.637771 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633002    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633004    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633007    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633009    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633012    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633014    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633017    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633019    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633022    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633025    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633027    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633029    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633032    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633035    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633037    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633040    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633042    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633044    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633047    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:06:41.638144 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633049    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633053    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633056    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633059    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633062    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633064    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633067    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633069    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633071    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633074    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633078    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633081    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633084    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633086    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633089    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633092    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633094    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633097    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633100    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:06:41.638588 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633103    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633122    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633126    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633128    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633130    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633133    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633135    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633138    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633140    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633143    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633146    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633148    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633150    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633153    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633155    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633158    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633160    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633162    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633165    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633167    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:06:41.639029 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633170    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633173    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633175    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633177    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633180    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633182    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633185    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633188    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633190    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633193    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633195    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633198    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633200    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633202    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633205    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633207    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633210    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633212    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633214    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633217    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:06:41.639508 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633219    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633221    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633224    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633226    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633229    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633231    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633233    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:41.633236    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.633240    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.633327    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.635470    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.636457    2578 server.go:1019] "Starting client certificate rotation"
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.636555    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:06:41.639967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.636594    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:06:41.640322 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.639061    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:06:41.640322 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.640126    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:06:41.650302 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.650284    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 09 23:06:41.653468 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.653455    2578 log.go:25] "Validated CRI v1 image API"
Sep 09 23:06:41.654264 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.654241    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 23:06:41.657566 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.657543    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 caab9f6d-dc0b-436b-9129-3f854761087c:/dev/nvme0n1p4 de54c608-9431-4e85-90f2-1a29938b618c:/dev/nvme0n1p3]
Sep 09 23:06:41.657632 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.657566    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 23:06:41.663304 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.663199    2578 manager.go:216] Machine: {Timestamp:2026-09-09 23:06:41.660983496 +0000 UTC m=+0.268593145 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109756 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2215d7d1712e028c1ebe9f4f1ceb55 SystemUUID:ec2215d7-d171-2e02-8c1e-be9f4f1ceb55 BootID:5cf8f056-43a8-4c6d-aecd-b577d61b6e6b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:71:4c:5a:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:71:4c:5a:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:80:76:cf:46:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 23:06:41.663304 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.663303    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 23:06:41.663402 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.663368    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 23:06:41.664819 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.664806    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:06:41.666859 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.666834    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 23:06:41.666987 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.666863    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 23:06:41.667755 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.667746    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 23:06:41.667790 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.667757    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 23:06:41.667790 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.667764    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:06:41.667790 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.667777    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:06:41.669615 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.669606    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 23:06:41.674054 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674042    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:06:41.674172 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674163    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 23:06:41.674206 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674193    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 23:06:41.674236 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674216    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 23:06:41.674265 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674239    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 23:06:41.674265 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674251    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 09 23:06:41.674265 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674262    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 23:06:41.674610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674598    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:06:41.674681 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.674620    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:06:41.678486 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.678467    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 23:06:41.681223 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681209    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 23:06:41.681274 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681239    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 23:06:41.681399 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681389    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 23:06:41.681447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681404    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 23:06:41.681447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681409    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 23:06:41.681447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681414    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 23:06:41.681447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681421    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 23:06:41.681447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.681426    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 23:06:41.682150 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682140    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 23:06:41.682150 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682150    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 23:06:41.682215 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682158    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 23:06:41.682215 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682163    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 23:06:41.682215 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682180    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 23:06:41.682215 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.682194    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 23:06:41.682736 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.682717    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 23:06:41.682846 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.682827    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 23:06:41.683119 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.683094    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 23:06:41.683161 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.683123    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 23:06:41.685803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.685788    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 23:06:41.686250 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.686232    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9h96t"
Sep 09 23:06:41.686629 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.686613    2578 server.go:1268] "Started kubelet"
Sep 09 23:06:41.686900 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.686726    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 23:06:41.686900 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.686803    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 23:06:41.687227 ip-10-0-138-84 systemd[1]: Started Kubernetes Kubelet.
Sep 09 23:06:41.687405 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.687224    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 23:06:41.688232 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.688216    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 23:06:41.694589 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.693776    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9h96t"
Sep 09 23:06:41.694677 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.694587    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 23:06:41.695246 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.695224    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 23:06:41.697041 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.695979    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-84.ec2.internal.18d3c9a84d684a9c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-84.ec2.internal,UID:ip-10-0-138-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-84.ec2.internal,},FirstTimestamp:2026-09-09 23:06:41.68658806 +0000 UTC m=+0.294197709,LastTimestamp:2026-09-09 23:06:41.68658806 +0000 UTC m=+0.294197709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-84.ec2.internal,}"
Sep 09 23:06:41.699150 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.699130    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 23:06:41.699790 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.699776    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 23:06:41.699986 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.699928    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:41.700611 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700478    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 23:06:41.700611 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700494    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 23:06:41.700611 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700579    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 23:06:41.700611 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700609    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 23:06:41.700798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700615    2578 factory.go:55] Registering systemd factory
Sep 09 23:06:41.700798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700655    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 09 23:06:41.700798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.700617    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 23:06:41.701035 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701023    2578 factory.go:153] Registering CRI-O factory
Sep 09 23:06:41.701035 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701037    2578 factory.go:223] Registration of the crio container factory successfully
Sep 09 23:06:41.701148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701082    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 23:06:41.701148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701098    2578 factory.go:103] Registering Raw factory
Sep 09 23:06:41.701148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701124    2578 manager.go:1196] Started watching for new ooms in manager
Sep 09 23:06:41.701463 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.701450    2578 manager.go:349] Starting recovery of all containers
Sep 09 23:06:41.710254 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.710230    2578 manager.go:354] Recovery completed
Sep 09 23:06:41.711789 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.711568    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:41.714213 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.714193    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-84.ec2.internal\" not found" node="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:41.715099 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.715086    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:41.716613 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.716599    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:41.716672 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.716628    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:41.716672 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.716638    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:41.717090 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717079    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 23:06:41.717186 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717089    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 23:06:41.717186 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717103    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:06:41.717265 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717138    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:41.717873 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717857    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:41.717938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717880    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:41.717938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.717892    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:41.800335 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.800312    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:41.860352 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.859895    2578 policy_none.go:49] "None policy: Start"
Sep 09 23:06:41.860352 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.859908    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 23:06:41.860352 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.859917    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 23:06:41.861019 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.861005    2578 policy_none.go:47] "Start"
Sep 09 23:06:41.891616 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.891600    2578 manager.go:337] "Starting Device Plugin manager"
Sep 09 23:06:41.891697 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.891636    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 23:06:41.891697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.891649    2578 server.go:87] "Starting device plugin registration server"
Sep 09 23:06:41.891899 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.891887    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 23:06:41.891964 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.891900    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 23:06:41.892014 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.891998    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 23:06:41.892076 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.892064    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 23:06:41.892138 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.892077    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 23:06:41.892517 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.892498    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 23:06:41.892603 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.892544    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:41.944096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.944069    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 23:06:41.945196 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.945175    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 23:06:41.945272 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.945225    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 23:06:41.945272 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.945245    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 23:06:41.945364 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:41.945311    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 23:06:41.947599 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.947582    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:41.992337 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.992320    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:41.993028 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.993009    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:41.993096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.993035    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:41.993096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.993045    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:41.993096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:41.993062    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.001208 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.001195    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.001257 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.001213    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-84.ec2.internal\": node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.046024 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.046006    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"]
Sep 09 23:06:42.046093 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.046053    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:42.046319 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.046306    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.046921 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.046902    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:42.047001 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.046929    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:42.047001 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.046938    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:42.048038 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048027    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:42.048163 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048149    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.048213 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048174    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:42.048742 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048727    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:42.048803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048731    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:42.048803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048750    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:42.048803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048762    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:42.048803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048768    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:42.048803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.048779    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:42.049756 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.049740    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.049820 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.049764    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:06:42.050449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.050432    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:06:42.050522 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.050457    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:06:42.050522 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.050467    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:06:42.077568 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.077555    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-84.ec2.internal\" not found" node="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.081729 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.081714    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-84.ec2.internal\" not found" node="ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.102628 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.102610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f40080e6fa7848a7df4ac3ee5efb921c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"f40080e6fa7848a7df4ac3ee5efb921c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.102708 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.102630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.102708 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.102644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.146585 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.146547    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.202772 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.202860 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f40080e6fa7848a7df4ac3ee5efb921c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"f40080e6fa7848a7df4ac3ee5efb921c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.202860 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.202860 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.202860 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f40080e6fa7848a7df4ac3ee5efb921c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-84.ec2.internal\" (UID: \"f40080e6fa7848a7df4ac3ee5efb921c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.203002 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.202861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/48e69dee52b971bcf26fe7d1cc5b0fc3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal\" (UID: \"48e69dee52b971bcf26fe7d1cc5b0fc3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.246895 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.246869    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.347327 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.347298    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.380473 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.380456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.383890 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.383875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.447613 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.447570    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.547994 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.547977    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.636445 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.636425    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 23:06:42.636818 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.636526    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:06:42.636818 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.636561    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:06:42.648680 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.648663    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.698816 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.698768    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:01:42 +0000 UTC" deadline="2028-04-28 09:02:20.701850753 +0000 UTC"
Sep 09 23:06:42.698816 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.698790    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14313h55m38.003065194s"
Sep 09 23:06:42.749131 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:42.749101    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-84.ec2.internal\" not found"
Sep 09 23:06:42.768906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.768890    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:42.800644 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.800625    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.809606 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.809594    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:06:42.811283 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.811271    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal"
Sep 09 23:06:42.821084 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:42.821071    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:06:43.173630 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:43.173596    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40080e6fa7848a7df4ac3ee5efb921c.slice/crio-9af0c150c20fc1058a111e7f456d856fb6979bcf60ccbd3d4f1ecbdfa743ace7 WatchSource:0}: Error finding container 9af0c150c20fc1058a111e7f456d856fb6979bcf60ccbd3d4f1ecbdfa743ace7: Status 404 returned error can't find the container with id 9af0c150c20fc1058a111e7f456d856fb6979bcf60ccbd3d4f1ecbdfa743ace7
Sep 09 23:06:43.173976 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:43.173960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e69dee52b971bcf26fe7d1cc5b0fc3.slice/crio-4276963b9c8ecd329cbb5de6ea0f5bbf415c27ba7fb83ac6dfd246ec3803607e WatchSource:0}: Error finding container 4276963b9c8ecd329cbb5de6ea0f5bbf415c27ba7fb83ac6dfd246ec3803607e: Status 404 returned error can't find the container with id 4276963b9c8ecd329cbb5de6ea0f5bbf415c27ba7fb83ac6dfd246ec3803607e
Sep 09 23:06:43.178288 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.178265    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:06:43.204229 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.204209    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:43.675229 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.675205    2578 apiserver.go:52] "Watching apiserver"
Sep 09 23:06:43.681670 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.681647    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 23:06:43.684036 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.684000    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-6hdj7","openshift-ovn-kubernetes/ovnkube-node-vgrqf","kube-system/global-pull-secret-syncer-bvw4w","kube-system/konnectivity-agent-zvhhj","kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl","openshift-cluster-node-tuning-operator/tuned-2shjv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal","openshift-multus/multus-additional-cni-plugins-nsmgq","openshift-multus/multus-d898d","openshift-dns/node-resolver-t9wcg","openshift-image-registry/node-ca-cd426","openshift-multus/network-metrics-daemon-dkvjn","openshift-network-diagnostics/network-check-target-z8nk4"]
Sep 09 23:06:43.685851 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.685622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.688641 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.688306    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.689331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.689309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.689771 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.689751    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kthg9\""
Sep 09 23:06:43.690064 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.690042    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.693108 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:43.693226 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.693163    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:43.693296 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693260    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.695638 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693637    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.695638 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693655    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.695638 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.695638 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.693868    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xm2gn\""
Sep 09 23:06:43.695638 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.694056    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:43.696711 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.696691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 23:06:43.696969 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.696950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.697381 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.696963    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hqcwb\""
Sep 09 23:06:43.697646 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.697495    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 23:06:43.698418 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.698398    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.699439    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.699655    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.699690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.699844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4nxc9\""
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.700049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.700212 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.700107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:43.701331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.700523    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 23:06:43.701331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.700639    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 23:06:43.701331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.701053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.701331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.701309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 23:06:43.701331 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.701323    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wqdj6\""
Sep 09 23:06:43.701652 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.701515    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.701711 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.701672    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 23:06:43.703799 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.703052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.704796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.704510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.705477 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.705456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 23:06:43.705814 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.705796    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.706004 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.705984    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.706303 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.706285    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 23:06:43.706565 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.706311    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 23:06:43.706676 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.706365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2c6gs\""
Sep 09 23:06:43.706742 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.706732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.706802 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.706628    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 23:06:43.707318 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.707299    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jd6js\""
Sep 09 23:06:43.707771 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.707696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.708688 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.708667    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 23:06:43.710586 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710563    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d586165e-169f-46fd-ae66-088ce2cfd7f4-tmp-dir\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.710972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-ovn\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.710986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nr8j\" (UniqueName: \"kubernetes.io/projected/e02771bb-b1f1-4c74-91d8-2a782e7485f0-kube-api-access-4nr8j\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-config\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-env-overrides\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvv7q\" (UniqueName: \"kubernetes.io/projected/d586165e-169f-46fd-ae66-088ce2cfd7f4-kube-api-access-xvv7q\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-run\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-sys\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-systemd-units\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711308 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-script-lib\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-etc-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7d1adce-1c01-45a7-b895-e7697102a6f6-agent-certs\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-log-socket\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-bin\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-tuned\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-system-cni-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711539    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-netd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-device-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-cnibin\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7zx6\" (UniqueName: \"kubernetes.io/projected/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kube-api-access-q7zx6\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.711931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.711842    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-kubelet-config\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.712635 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.712490    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.712772 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.712752    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 23:06:43.712882 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.712776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z6zvd\""
Sep 09 23:06:43.712882 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.712787    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 23:06:43.713022 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713006    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 23:06:43.713079 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713049    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dsb9k\""
Sep 09 23:06:43.713610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.713610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-var-lib-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.713610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.713610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d586165e-169f-46fd-ae66-088ce2cfd7f4-hosts-file\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.713610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-node-log\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7d1adce-1c01-45a7-b895-e7697102a6f6-konnectivity-ca\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-host\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-kubelet\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-conf\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-var-lib-kubelet\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-tmp\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqrt\" (UniqueName: \"kubernetes.io/projected/d85130e3-071d-454d-9199-3125c46a4ebc-kube-api-access-lmqrt\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.713982    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-netns\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-systemd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxbmr\" (UniqueName: \"kubernetes.io/projected/536bc265-2185-4109-a0a4-2762b47b0ecf-kube-api-access-fxbmr\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwp49\" (UniqueName: \"kubernetes.io/projected/cb517cf6-6b04-4901-bc1d-4b37f5302657-kube-api-access-bwp49\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-kubernetes\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.714825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-lib-modules\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-systemd\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-slash\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536bc265-2185-4109-a0a4-2762b47b0ecf-ovn-node-metrics-cert\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-modprobe-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysconfig\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.714338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-dbus\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.715903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.715479    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:06:43.733595 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.733576    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m56c9"
Sep 09 23:06:43.741532 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.741513    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m56c9"
Sep 09 23:06:43.801914 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.801846    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 23:06:43.815340 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-sys\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-systemd-units\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-script-lib\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-host\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrctb\" (UniqueName: \"kubernetes.io/projected/bd7b11f2-ddde-4719-bf8f-2fba993e822c-kube-api-access-xrctb\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.815449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-etc-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7d1adce-1c01-45a7-b895-e7697102a6f6-agent-certs\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815475    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbdt\" (UniqueName: \"kubernetes.io/projected/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-kube-api-access-kvbdt\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-log-socket\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815505    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-bin\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-conf-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-tuned\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-system-cni-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-netd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-device-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9d26028-4c71-43f0-981b-5699d9a4ff72-iptables-alerter-script\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-system-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-hostroot\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-cnibin\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7zx6\" (UniqueName: \"kubernetes.io/projected/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kube-api-access-q7zx6\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-serviceca\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.815796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-kubelet-config\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-bin\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-var-lib-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d586165e-169f-46fd-ae66-088ce2cfd7f4-hosts-file\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-socket-dir-parent\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cnibin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-node-log\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.815991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7d1adce-1c01-45a7-b895-e7697102a6f6-konnectivity-ca\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92k5l\" (UniqueName: \"kubernetes.io/projected/c9d26028-4c71-43f0-981b-5699d9a4ff72-kube-api-access-92k5l\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-sys\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-host\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-kubelet\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816113    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-systemd-units\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.816564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-binary-copy\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-daemon-config\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-conf\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-var-lib-kubelet\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-tmp\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816283    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqrt\" (UniqueName: \"kubernetes.io/projected/d85130e3-071d-454d-9199-3125c46a4ebc-kube-api-access-lmqrt\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-netns\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816365    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-systemd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxbmr\" (UniqueName: \"kubernetes.io/projected/536bc265-2185-4109-a0a4-2762b47b0ecf-kube-api-access-fxbmr\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwp49\" (UniqueName: \"kubernetes.io/projected/cb517cf6-6b04-4901-bc1d-4b37f5302657-kube-api-access-bwp49\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-kubernetes\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-lib-modules\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-sys-fs\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9d26028-4c71-43f0-981b-5699d9a4ff72-host-slash\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-k8s-cni-cncf-io\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.817135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-etc-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-multus-certs\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816642    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-systemd\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-slash\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-log-socket\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536bc265-2185-4109-a0a4-2762b47b0ecf-ovn-node-metrics-cert\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-var-lib-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-script-lib\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-etc-kubernetes\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-systemd\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-modprobe-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysconfig\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-dbus\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816886    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-system-cni-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.816984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d586165e-169f-46fd-ae66-088ce2cfd7f4-tmp-dir\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.818115 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cni-binary-copy\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-kubelet\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-netns\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-ovn\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-multus\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nr8j\" (UniqueName: \"kubernetes.io/projected/e02771bb-b1f1-4c74-91d8-2a782e7485f0-kube-api-access-4nr8j\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-config\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-env-overrides\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvv7q\" (UniqueName: \"kubernetes.io/projected/d586165e-169f-46fd-ae66-088ce2cfd7f4-kube-api-access-xvv7q\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.819069 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-bin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-run\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-run\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.817832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-netns\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d586165e-169f-46fd-ae66-088ce2cfd7f4-tmp-dir\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-systemd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818555    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-cni-netd\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-device-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.818873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-kubernetes\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-lib-modules\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-openvswitch\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-run-ovn\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819266    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d85130e3-071d-454d-9199-3125c46a4ebc-cnibin\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-kubelet-config\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.819552    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:43.819879 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.819605    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.819642    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:44.319620131 +0000 UTC m=+2.927229792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.819747    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:44.319730435 +0000 UTC m=+2.927340078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819753    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-slash\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.819829    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-registration-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820366    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-ovnkube-config\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7d1adce-1c01-45a7-b895-e7697102a6f6-konnectivity-ca\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d586165e-169f-46fd-ae66-088ce2cfd7f4-hosts-file\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysctl-conf\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820518    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-var-lib-kubelet\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-host-kubelet\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-host\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-socket-dir\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/536bc265-2185-4109-a0a4-2762b47b0ecf-node-log\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.820787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-modprobe-d\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.821687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-etc-selinux\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.821687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820792    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/536bc265-2185-4109-a0a4-2762b47b0ecf-env-overrides\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.821687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-sysconfig\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.821687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.820910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/edb270ef-73e9-4ffe-b404-10113db3a147-dbus\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:43.821687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.821163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d85130e3-071d-454d-9199-3125c46a4ebc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.822672 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.822614    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/536bc265-2185-4109-a0a4-2762b47b0ecf-ovn-node-metrics-cert\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.823317 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.823261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-tmp\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.823801 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.823560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7d1adce-1c01-45a7-b895-e7697102a6f6-agent-certs\") pod \"konnectivity-agent-zvhhj\" (UID: \"d7d1adce-1c01-45a7-b895-e7697102a6f6\") " pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:43.823801 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.823722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e02771bb-b1f1-4c74-91d8-2a782e7485f0-etc-tuned\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.827866 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.827829    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:43.827866 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.827850    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:43.827866 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.827866    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:43.828077 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:43.827926    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:06:44.327910058 +0000 UTC m=+2.935519700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:43.832695 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.832618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqrt\" (UniqueName: \"kubernetes.io/projected/d85130e3-071d-454d-9199-3125c46a4ebc-kube-api-access-lmqrt\") pod \"multus-additional-cni-plugins-nsmgq\" (UID: \"d85130e3-071d-454d-9199-3125c46a4ebc\") " pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:43.832910 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.832888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nr8j\" (UniqueName: \"kubernetes.io/projected/e02771bb-b1f1-4c74-91d8-2a782e7485f0-kube-api-access-4nr8j\") pod \"tuned-2shjv\" (UID: \"e02771bb-b1f1-4c74-91d8-2a782e7485f0\") " pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:43.833546 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.833401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7zx6\" (UniqueName: \"kubernetes.io/projected/445210f7-2e0c-40f6-8bf2-08c14ce7cf9d-kube-api-access-q7zx6\") pod \"aws-ebs-csi-driver-node-9v4sl\" (UID: \"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:43.833546 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.833439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwp49\" (UniqueName: \"kubernetes.io/projected/cb517cf6-6b04-4901-bc1d-4b37f5302657-kube-api-access-bwp49\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:43.834904 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.834854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxbmr\" (UniqueName: \"kubernetes.io/projected/536bc265-2185-4109-a0a4-2762b47b0ecf-kube-api-access-fxbmr\") pod \"ovnkube-node-vgrqf\" (UID: \"536bc265-2185-4109-a0a4-2762b47b0ecf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:43.836005 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.835527    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvv7q\" (UniqueName: \"kubernetes.io/projected/d586165e-169f-46fd-ae66-088ce2cfd7f4-kube-api-access-xvv7q\") pod \"node-resolver-t9wcg\" (UID: \"d586165e-169f-46fd-ae66-088ce2cfd7f4\") " pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:43.862364 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.862339    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:43.919055 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.918995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92k5l\" (UniqueName: \"kubernetes.io/projected/c9d26028-4c71-43f0-981b-5699d9a4ff72-kube-api-access-92k5l\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.919055 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-daemon-config\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9d26028-4c71-43f0-981b-5699d9a4ff72-host-slash\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-k8s-cni-cncf-io\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919145    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-multus-certs\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-etc-kubernetes\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9d26028-4c71-43f0-981b-5699d9a4ff72-host-slash\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cni-binary-copy\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-kubelet\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919275    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-k8s-cni-cncf-io\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-netns\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-etc-kubernetes\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-multus-certs\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-multus\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919371    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-kubelet\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-bin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-host\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-run-netns\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.919720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrctb\" (UniqueName: \"kubernetes.io/projected/bd7b11f2-ddde-4719-bf8f-2fba993e822c-kube-api-access-xrctb\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbdt\" (UniqueName: \"kubernetes.io/projected/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-kube-api-access-kvbdt\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919462    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-conf-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-multus\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-host\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9d26028-4c71-43f0-981b-5699d9a4ff72-iptables-alerter-script\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-host-var-lib-cni-bin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-system-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919599    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-hostroot\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-system-cni-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-serviceca\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-hostroot\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-socket-dir-parent\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cnibin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-daemon-config\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919800    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cnibin\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919855    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd7b11f2-ddde-4719-bf8f-2fba993e822c-cni-binary-copy\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.920643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.919991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-conf-dir\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.921530 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.920073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c9d26028-4c71-43f0-981b-5699d9a4ff72-iptables-alerter-script\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.921530 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.920088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bd7b11f2-ddde-4719-bf8f-2fba993e822c-multus-socket-dir-parent\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.921530 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.920162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-serviceca\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.929729 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.929640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrctb\" (UniqueName: \"kubernetes.io/projected/bd7b11f2-ddde-4719-bf8f-2fba993e822c-kube-api-access-xrctb\") pod \"multus-d898d\" (UID: \"bd7b11f2-ddde-4719-bf8f-2fba993e822c\") " pod="openshift-multus/multus-d898d"
Sep 09 23:06:43.929729 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.929670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbdt\" (UniqueName: \"kubernetes.io/projected/830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf-kube-api-access-kvbdt\") pod \"node-ca-cd426\" (UID: \"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf\") " pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:43.931929 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.931886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92k5l\" (UniqueName: \"kubernetes.io/projected/c9d26028-4c71-43f0-981b-5699d9a4ff72-kube-api-access-92k5l\") pod \"iptables-alerter-6hdj7\" (UID: \"c9d26028-4c71-43f0-981b-5699d9a4ff72\") " pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:43.951479 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.951422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"48e69dee52b971bcf26fe7d1cc5b0fc3","Type":"ContainerStarted","Data":"4276963b9c8ecd329cbb5de6ea0f5bbf415c27ba7fb83ac6dfd246ec3803607e"}
Sep 09 23:06:43.952912 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.952865    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" event={"ID":"f40080e6fa7848a7df4ac3ee5efb921c","Type":"ContainerStarted","Data":"9af0c150c20fc1058a111e7f456d856fb6979bcf60ccbd3d4f1ecbdfa743ace7"}
Sep 09 23:06:43.979146 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:43.979124    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:06:44.005330 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.005309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2shjv"
Sep 09 23:06:44.016234 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.016215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t9wcg"
Sep 09 23:06:44.020680 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.020653    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02771bb_b1f1_4c74_91d8_2a782e7485f0.slice/crio-e7a05379c27b4d742daf1231f0fcd75e725776aa42ae35d45111f59c5a275837 WatchSource:0}: Error finding container e7a05379c27b4d742daf1231f0fcd75e725776aa42ae35d45111f59c5a275837: Status 404 returned error can't find the container with id e7a05379c27b4d742daf1231f0fcd75e725776aa42ae35d45111f59c5a275837
Sep 09 23:06:44.028172 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.027931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:06:44.028924 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.028692    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd586165e_169f_46fd_ae66_088ce2cfd7f4.slice/crio-86f62885991a3fffafee2ee7cbdff50eb0c24217d5c5a190960565fc53c7eeb7 WatchSource:0}: Error finding container 86f62885991a3fffafee2ee7cbdff50eb0c24217d5c5a190960565fc53c7eeb7: Status 404 returned error can't find the container with id 86f62885991a3fffafee2ee7cbdff50eb0c24217d5c5a190960565fc53c7eeb7
Sep 09 23:06:44.035397 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.035291    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl"
Sep 09 23:06:44.043064 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.042877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nsmgq"
Sep 09 23:06:44.045707 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.045630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d1adce_1c01_45a7_b895_e7697102a6f6.slice/crio-1b81289e6f7c5403111f155b720374c8969bf7a3574983dd15c843057822c908 WatchSource:0}: Error finding container 1b81289e6f7c5403111f155b720374c8969bf7a3574983dd15c843057822c908: Status 404 returned error can't find the container with id 1b81289e6f7c5403111f155b720374c8969bf7a3574983dd15c843057822c908
Sep 09 23:06:44.046900 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.046864    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445210f7_2e0c_40f6_8bf2_08c14ce7cf9d.slice/crio-82e77d5d2d5645c7cfb1dec937eed151a556af608baf6a100325c3da4fc23544 WatchSource:0}: Error finding container 82e77d5d2d5645c7cfb1dec937eed151a556af608baf6a100325c3da4fc23544: Status 404 returned error can't find the container with id 82e77d5d2d5645c7cfb1dec937eed151a556af608baf6a100325c3da4fc23544
Sep 09 23:06:44.052220 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.051409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:06:44.056489 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.056467    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85130e3_071d_454d_9199_3125c46a4ebc.slice/crio-aeaeb1c1a9ea496b803c222d40ebe1557d3b0a59dfb49b98d66d2fa625a72872 WatchSource:0}: Error finding container aeaeb1c1a9ea496b803c222d40ebe1557d3b0a59dfb49b98d66d2fa625a72872: Status 404 returned error can't find the container with id aeaeb1c1a9ea496b803c222d40ebe1557d3b0a59dfb49b98d66d2fa625a72872
Sep 09 23:06:44.059374 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.059355    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d898d"
Sep 09 23:06:44.061581 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.061552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod536bc265_2185_4109_a0a4_2762b47b0ecf.slice/crio-978d05f0f331d04a2e6d82a0beb16085772f717341d8851647e38d18ecd24f40 WatchSource:0}: Error finding container 978d05f0f331d04a2e6d82a0beb16085772f717341d8851647e38d18ecd24f40: Status 404 returned error can't find the container with id 978d05f0f331d04a2e6d82a0beb16085772f717341d8851647e38d18ecd24f40
Sep 09 23:06:44.069641 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.069431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hdj7"
Sep 09 23:06:44.070261 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.070223    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7b11f2_ddde_4719_bf8f_2fba993e822c.slice/crio-95431a4240158e376bfe0fbda66a711f9c8aa882160abeb02454ef1ab1466d84 WatchSource:0}: Error finding container 95431a4240158e376bfe0fbda66a711f9c8aa882160abeb02454ef1ab1466d84: Status 404 returned error can't find the container with id 95431a4240158e376bfe0fbda66a711f9c8aa882160abeb02454ef1ab1466d84
Sep 09 23:06:44.077365 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:44.077341    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d26028_4c71_43f0_981b_5699d9a4ff72.slice/crio-f8ae5ea75903ba27cc797c8e4bb7ac0ea09f9acce8a76229d2743041451cbf00 WatchSource:0}: Error finding container f8ae5ea75903ba27cc797c8e4bb7ac0ea09f9acce8a76229d2743041451cbf00: Status 404 returned error can't find the container with id f8ae5ea75903ba27cc797c8e4bb7ac0ea09f9acce8a76229d2743041451cbf00
Sep 09 23:06:44.081391 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.081370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cd426"
Sep 09 23:06:44.321874 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.321796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:44.321874 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.321840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:44.322090 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.321960    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:44.322090 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.321961    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:44.322090 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.322017    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:45.32199916 +0000 UTC m=+3.929608800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:44.322090 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.322039    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:45.322028474 +0000 UTC m=+3.929638113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:44.422699 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.422670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:44.422884 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.422846    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:44.422884 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.422867    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:44.422884 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.422881    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:44.423050 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.422936    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:06:45.422920144 +0000 UTC m=+4.030529793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:44.746743 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.746625    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:01:44 +0000 UTC" deadline="2028-05-31 14:48:27.670051824 +0000 UTC"
Sep 09 23:06:44.746743 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.746696    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15111h41m42.923360992s"
Sep 09 23:06:44.946123 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.946090    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:44.946316 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.946244    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:44.946991 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.946659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:44.946991 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.946756    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:44.946991 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.946827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:44.946991 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:44.946894    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:44.957780 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.957718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvhhj" event={"ID":"d7d1adce-1c01-45a7-b895-e7697102a6f6","Type":"ContainerStarted","Data":"1b81289e6f7c5403111f155b720374c8969bf7a3574983dd15c843057822c908"}
Sep 09 23:06:44.959445 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.959381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t9wcg" event={"ID":"d586165e-169f-46fd-ae66-088ce2cfd7f4","Type":"ContainerStarted","Data":"86f62885991a3fffafee2ee7cbdff50eb0c24217d5c5a190960565fc53c7eeb7"}
Sep 09 23:06:44.961177 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.961089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2shjv" event={"ID":"e02771bb-b1f1-4c74-91d8-2a782e7485f0","Type":"ContainerStarted","Data":"e7a05379c27b4d742daf1231f0fcd75e725776aa42ae35d45111f59c5a275837"}
Sep 09 23:06:44.962905 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.962843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hdj7" event={"ID":"c9d26028-4c71-43f0-981b-5699d9a4ff72","Type":"ContainerStarted","Data":"f8ae5ea75903ba27cc797c8e4bb7ac0ea09f9acce8a76229d2743041451cbf00"}
Sep 09 23:06:44.965473 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.965375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"978d05f0f331d04a2e6d82a0beb16085772f717341d8851647e38d18ecd24f40"}
Sep 09 23:06:44.967426 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.967379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d898d" event={"ID":"bd7b11f2-ddde-4719-bf8f-2fba993e822c","Type":"ContainerStarted","Data":"95431a4240158e376bfe0fbda66a711f9c8aa882160abeb02454ef1ab1466d84"}
Sep 09 23:06:44.969886 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.969823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerStarted","Data":"aeaeb1c1a9ea496b803c222d40ebe1557d3b0a59dfb49b98d66d2fa625a72872"}
Sep 09 23:06:44.973018 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:44.972988    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl" event={"ID":"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d","Type":"ContainerStarted","Data":"82e77d5d2d5645c7cfb1dec937eed151a556af608baf6a100325c3da4fc23544"}
Sep 09 23:06:45.330468 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:45.330431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:45.330661 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:45.330492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:45.330730 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.330673    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:45.330785 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.330736    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:47.33071613 +0000 UTC m=+5.938325785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:45.331230 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.331129    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:45.331230 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.331181    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:47.331164995 +0000 UTC m=+5.938774650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:45.426484 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:06:45.424523    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830fe17e_6cc1_4c9d_a7c8_c3a087eefcbf.slice/crio-c6d080fd09688ab350c775676e3876bfc74986be66b635bfa70a41376ccf1fe0 WatchSource:0}: Error finding container c6d080fd09688ab350c775676e3876bfc74986be66b635bfa70a41376ccf1fe0: Status 404 returned error can't find the container with id c6d080fd09688ab350c775676e3876bfc74986be66b635bfa70a41376ccf1fe0
Sep 09 23:06:45.431576 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:45.431551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:45.431713 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.431695    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:45.431775 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.431721    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:45.431775 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.431734    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:45.431883 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:45.431802    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:06:47.431784236 +0000 UTC m=+6.039393879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:45.747631 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:45.747515    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:01:44 +0000 UTC" deadline="2028-05-27 10:05:58.474187514 +0000 UTC"
Sep 09 23:06:45.747631 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:45.747554    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15010h59m12.72663852s"
Sep 09 23:06:46.001337 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.000624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" event={"ID":"f40080e6fa7848a7df4ac3ee5efb921c","Type":"ContainerStarted","Data":"28391eb452e1bec3b1f235a0119ea6cfa8580fe29e5f481607f0373ce8c5fcf1"}
Sep 09 23:06:46.019641 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.018391    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-84.ec2.internal" podStartSLOduration=3.01837345 podStartE2EDuration="3.01837345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:06:46.018145805 +0000 UTC m=+4.625755485" watchObservedRunningTime="2026-09-09 23:06:46.01837345 +0000 UTC m=+4.625983128"
Sep 09 23:06:46.020253 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.020169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cd426" event={"ID":"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf","Type":"ContainerStarted","Data":"c6d080fd09688ab350c775676e3876bfc74986be66b635bfa70a41376ccf1fe0"}
Sep 09 23:06:46.947239 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.946371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:46.947239 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:46.946516    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:46.947239 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.946966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:46.947239 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:46.947079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:46.947239 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:46.947151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:46.948041 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:46.947269    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:47.038455 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:47.038355    2578 generic.go:356] "Generic (PLEG): container finished" podID="48e69dee52b971bcf26fe7d1cc5b0fc3" containerID="2b0dfc80240f9dbe573e7173ed23c503c6d32e438fc71dd97e7996a32f0639ff" exitCode=0
Sep 09 23:06:47.038455 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:47.038442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"48e69dee52b971bcf26fe7d1cc5b0fc3","Type":"ContainerDied","Data":"2b0dfc80240f9dbe573e7173ed23c503c6d32e438fc71dd97e7996a32f0639ff"}
Sep 09 23:06:47.348081 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:47.348000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:47.348081 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:47.348064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:47.348331 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.348242    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:47.348331 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.348304    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:51.348285321 +0000 UTC m=+9.955894964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:47.348700 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.348684    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:47.348792 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.348732    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:51.348718033 +0000 UTC m=+9.956327674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:47.449300 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:47.449267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:47.449463 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.449430    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:47.449463 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.449453    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:47.449587 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.449467    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:47.449587 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:47.449533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:06:51.44951359 +0000 UTC m=+10.057123235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:48.945841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:48.945810    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:48.946321 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:48.945808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:48.946321 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:48.945937    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:48.946321 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:48.945978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:48.946321 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:48.946091    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:48.946321 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:48.946201    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:50.945613 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:50.945544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:50.946128 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:50.945548    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:50.946128 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:50.945669    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:50.946128 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:50.945681    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:50.946128 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:50.945772    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:50.946128 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:50.945862    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:51.383205 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:51.383127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:51.383205 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:51.383183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:51.383447 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.383327    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:51.383447 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.383354    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:51.383447 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.383398    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:59.38337817 +0000 UTC m=+17.990987810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:51.383447 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.383419    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:06:59.383409494 +0000 UTC m=+17.991019132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:51.484571 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:51.484537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:51.484740 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.484699    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:51.484740 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.484723    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:51.484740 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.484737    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:51.484887 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:51.484796    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:06:59.48477719 +0000 UTC m=+18.092386829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:52.946478 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:52.946443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:52.946877 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:52.946453    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:52.946877 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:52.946590    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:52.946877 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:52.946631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:52.946877 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:52.946695    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:52.946877 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:52.946768    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:54.945612 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:54.945542    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:54.945612 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:54.945580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:54.945612 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:54.945585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:54.946126 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:54.945670    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:54.946126 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:54.945736    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:54.946126 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:54.945853    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:56.945631 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:56.945559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:56.945631 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:56.945582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:56.946103 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:56.945688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:56.946103 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:56.945687    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:56.946103 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:56.945816    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:56.946103 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:56.945942    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:58.946158 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:58.946128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:58.946626 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:58.946170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:58.946626 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:58.946223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:58.946626 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:58.946241    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:06:58.946626 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:58.946304    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:06:58.946626 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:58.946365    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:06:59.441227 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:59.441194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:06:59.441388 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:59.441246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:06:59.441388 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.441346    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:59.441493 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.441346    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:59.441493 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.441433    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:15.441416828 +0000 UTC m=+34.049026465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:06:59.441493 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.441448    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:15.44144235 +0000 UTC m=+34.049051987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:06:59.541488 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:06:59.541463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:06:59.541637 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.541621    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:06:59.541680 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.541640    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:06:59.541680 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.541650    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:06:59.541752 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:06:59.541696    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:07:15.541683081 +0000 UTC m=+34.149292718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:07:00.945490 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:00.945459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:00.945490 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:00.945486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:00.945913 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:00.945495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:00.945913 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:00.945592    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:00.945913 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:00.945706    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:00.945913 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:00.945784    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:02.082228 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.080740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" event={"ID":"48e69dee52b971bcf26fe7d1cc5b0fc3","Type":"ContainerStarted","Data":"5bc5e0ca56ab4dfed83a592c4b71002c2464bdd70ecbd20ad0bb664530bb57f7"}
Sep 09 23:07:02.088411 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.087652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t9wcg" event={"ID":"d586165e-169f-46fd-ae66-088ce2cfd7f4","Type":"ContainerStarted","Data":"26ecd549c1fd7e95d78dad408868313a95b8a2a52ebd8609edfea51b3af9ca7b"}
Sep 09 23:07:02.124091 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.123372    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-84.ec2.internal" podStartSLOduration=19.123353265 podStartE2EDuration="19.123353265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:02.100592528 +0000 UTC m=+20.708202188" watchObservedRunningTime="2026-09-09 23:07:02.123353265 +0000 UTC m=+20.730962941"
Sep 09 23:07:02.946615 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.946460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:02.946747 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.946481    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:02.946747 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:02.946700    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:02.946817 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:02.946503    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:02.946817 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:02.946767    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:02.946890 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:02.946826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:03.090797 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.090764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d898d" event={"ID":"bd7b11f2-ddde-4719-bf8f-2fba993e822c","Type":"ContainerStarted","Data":"4b9ed85e20c3a7626667d244bfb34f0df1d4e468661e92f718aa10ba225357e1"}
Sep 09 23:07:03.092565 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.092538    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="0d376dc5e3e1cfcc2dae5f7c6e9235f70a7df2b321d3aa27df8653e7cd3e04fb" exitCode=0
Sep 09 23:07:03.092640 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.092612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"0d376dc5e3e1cfcc2dae5f7c6e9235f70a7df2b321d3aa27df8653e7cd3e04fb"}
Sep 09 23:07:03.094931 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.094906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl" event={"ID":"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d","Type":"ContainerStarted","Data":"40ac43efa5845bcd7a01ea5d12f72b2463d19c150953a2aeb496abf16f87be3c"}
Sep 09 23:07:03.096533 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.096504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvhhj" event={"ID":"d7d1adce-1c01-45a7-b895-e7697102a6f6","Type":"ContainerStarted","Data":"df76f9d8127ac1ad757921fd4e546f558ab6446fc5f951a269ecc74a725739da"}
Sep 09 23:07:03.098133 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.098093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2shjv" event={"ID":"e02771bb-b1f1-4c74-91d8-2a782e7485f0","Type":"ContainerStarted","Data":"ec39760188ecb67322b24858d1c93f3e5d32bce33e0fe4d5c43bdbc1ee7849ed"}
Sep 09 23:07:03.099436 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.099419    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 23:07:03.101199 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"e639c1b92bf77bc9c4400eb50b608109cc564e0c0f40505724932cbb8d84ea2e"}
Sep 09 23:07:03.101290 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"258f1b9df045dfe1739e290ccda793c6e08df76715c6039ecc2161e868b644e8"}
Sep 09 23:07:03.101290 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"3cc5f830526e9cc3f5a2b831048209a69087ead9596c05efc2940fe2f716fb96"}
Sep 09 23:07:03.101290 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101287    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"3ac2cb90d5c32bf15b39817f30192a4e7741ca2836e04ff7ace4c20362015a87"}
Sep 09 23:07:03.101404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"e7d522e92c43506cab315b6a029d99390c2b69ed0400524d31508f494990eb20"}
Sep 09 23:07:03.101404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.101342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"e11773027606205b51cca7c55661ebc6dd03fc1cce6a3d28dd9f3ec2699eab98"}
Sep 09 23:07:03.102398 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.102379    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cd426" event={"ID":"830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf","Type":"ContainerStarted","Data":"ef34f96697dc46a1ace946099393de32960ea393a8050182cbfbe8be6f1953d8"}
Sep 09 23:07:03.106151 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.106100    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d898d" podStartSLOduration=3.244308496 podStartE2EDuration="21.106089494s" totalImagesPullingTime="17.861780998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:03.105854359 +0000 UTC m=+21.713464017" watchObservedRunningTime="2026-09-09 23:07:03.106089494 +0000 UTC m=+21.713699153"
Sep 09 23:07:03.106233 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.106200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t9wcg" podStartSLOduration=3.219426628 podStartE2EDuration="21.106195593s" totalImagesPullingTime="17.886768965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:02.124070328 +0000 UTC m=+20.731679985" watchObservedRunningTime="2026-09-09 23:07:03.106195593 +0000 UTC m=+21.713805262"
Sep 09 23:07:03.136470 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.136435    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2shjv" podStartSLOduration=3.239635587 podStartE2EDuration="21.136424018s" totalImagesPullingTime="17.896788431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:03.1357905 +0000 UTC m=+21.743400158" watchObservedRunningTime="2026-09-09 23:07:03.136424018 +0000 UTC m=+21.744033686"
Sep 09 23:07:03.149181 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.149137    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zvhhj" podStartSLOduration=3.278106191 podStartE2EDuration="21.149097804s" totalImagesPullingTime="17.870991613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:03.148210705 +0000 UTC m=+21.755820362" watchObservedRunningTime="2026-09-09 23:07:03.149097804 +0000 UTC m=+21.756707464"
Sep 09 23:07:03.165075 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.165043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cd426" podStartSLOduration=4.670182978 podStartE2EDuration="21.165032886s" totalImagesPullingTime="16.494849908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:03.164760179 +0000 UTC m=+21.772369837" watchObservedRunningTime="2026-09-09 23:07:03.165032886 +0000 UTC m=+21.772642545"
Sep 09 23:07:03.902585 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.902486    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:07:03.099433422Z","UUID":"3fa15413-5ed1-4466-bac1-ece812e76c33","Handler":null,"Name":"","Endpoint":""}
Sep 09 23:07:03.904257 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.904228    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 23:07:03.904413 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:03.904285    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 23:07:04.106175 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.106141    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hdj7" event={"ID":"c9d26028-4c71-43f0-981b-5699d9a4ff72","Type":"ContainerStarted","Data":"431603e66504a0e5005ae213c65821cbe4b18e40d56b015c177c5989ff2b4e60"}
Sep 09 23:07:04.109062 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.109026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl" event={"ID":"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d","Type":"ContainerStarted","Data":"49546bb5460c8cfc2da847d09f08cdf25568bf932e82d26a14026fcb9dc90d5d"}
Sep 09 23:07:04.109169 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.109093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl" event={"ID":"445210f7-2e0c-40f6-8bf2-08c14ce7cf9d","Type":"ContainerStarted","Data":"2f8a186842d0517c4801730702705839ac60b0787787c6f08a3d9d21a2dbde69"}
Sep 09 23:07:04.120634 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.120590    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6hdj7" podStartSLOduration=4.301286102 podStartE2EDuration="22.120571674s" totalImagesPullingTime="17.819285572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:04.119989219 +0000 UTC m=+22.727598877" watchObservedRunningTime="2026-09-09 23:07:04.120571674 +0000 UTC m=+22.728181333"
Sep 09 23:07:04.350912 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.350880    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:07:04.946381 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.946163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:04.946513 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.946178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:04.946513 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:04.946419    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:04.946513 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:04.946504    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:04.946658 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:04.946192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:04.946658 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:04.946589    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:05.114846 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:05.114813    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"40f8ee09abf1e0739a567e781cc5760a0ca2a1b7e510b5f0c16eb23be3916d8b"}
Sep 09 23:07:05.131105 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:05.131056    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9v4sl" podStartSLOduration=3.455010958 podStartE2EDuration="23.131039823s" totalImagesPullingTime="19.676028865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:05.130800774 +0000 UTC m=+23.738410433" watchObservedRunningTime="2026-09-09 23:07:05.131039823 +0000 UTC m=+23.738649512"
Sep 09 23:07:06.946258 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:06.946237    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:06.946564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:06.946383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:06.946564 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:06.946398    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:06.946564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:06.946417    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:06.946564 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:06.946497    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:06.946716 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:06.946597    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:07.122040 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.122007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" event={"ID":"536bc265-2185-4109-a0a4-2762b47b0ecf","Type":"ContainerStarted","Data":"1ac8b87c9850c1ffd5376a764f8ff0c589abc7f9fdef626bb1fb2d37ae373fe3"}
Sep 09 23:07:07.122281 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.122264    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:07.137457 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.137436    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:07.146768 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.146719    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" podStartSLOduration=7.137957485 podStartE2EDuration="25.146706251s" totalImagesPullingTime="18.008748766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:07.146166229 +0000 UTC m=+25.753775887" watchObservedRunningTime="2026-09-09 23:07:07.146706251 +0000 UTC m=+25.754315910"
Sep 09 23:07:07.201075 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.201050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:07:07.201597 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:07.201580    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:07:08.125709 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.125549    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="7825343c2ff1c9b8b9e34a6490142251c7b5ac01b47e5663b94f3c2ca9fe6bec" exitCode=0
Sep 09 23:07:08.126221 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.125635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"7825343c2ff1c9b8b9e34a6490142251c7b5ac01b47e5663b94f3c2ca9fe6bec"}
Sep 09 23:07:08.126221 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.125831    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 23:07:08.126336 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.126276    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:08.126915 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.126506    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zvhhj"
Sep 09 23:07:08.140335 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.140318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:08.854236 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.854211    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8nk4"]
Sep 09 23:07:08.854392 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.854314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:08.854459 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:08.854405    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:08.857521 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.857490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvw4w"]
Sep 09 23:07:08.857656 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.857588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:08.857718 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:08.857672    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:08.858332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.858299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dkvjn"]
Sep 09 23:07:08.858445 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:08.858408    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:08.858564 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:08.858487    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:09.127824 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:09.127801    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 23:07:09.703993 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:09.703960    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:09.945898 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:09.945878    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:09.945983 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:09.945897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:09.945983 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:09.945883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:09.945983 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:09.945970    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:09.946101 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:09.946027    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:09.946101 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:09.946092    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:10.130967 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:10.130914    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="118dd6517d0f60f503bb0e9a503d4e8975388097848e3c6d3292670283f5d18a" exitCode=0
Sep 09 23:07:10.131358 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:10.130991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"118dd6517d0f60f503bb0e9a503d4e8975388097848e3c6d3292670283f5d18a"}
Sep 09 23:07:11.135889 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.135686    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="a03beb07533eb00fa8ab07f7fb0d8f257e1a2380f5675760940777c1d660bfd1" exitCode=0
Sep 09 23:07:11.135889 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.135770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"a03beb07533eb00fa8ab07f7fb0d8f257e1a2380f5675760940777c1d660bfd1"}
Sep 09 23:07:11.145183 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.145155    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf" podUID="536bc265-2185-4109-a0a4-2762b47b0ecf" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 09 23:07:11.946234 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.946165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:11.946413 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.946216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:11.946489 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:11.946411    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:11.946489 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:11.946242    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:11.946489 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:11.946456    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:11.946634 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:11.946535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:13.945747 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:13.945721    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:13.945747 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:13.945744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:13.946387 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:13.945720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:13.946387 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:13.945844    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z8nk4" podUID="6a326875-07e6-4260-a98d-15183bf9481b"
Sep 09 23:07:13.946387 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:13.945927    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bvw4w" podUID="edb270ef-73e9-4ffe-b404-10113db3a147"
Sep 09 23:07:13.946387 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:13.946007    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:07:14.734840 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.734773    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-84.ec2.internal" event="NodeReady"
Sep 09 23:07:14.734992 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.734890    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 23:07:14.774207 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.774176    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9knhx"]
Sep 09 23:07:14.827907 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.827880    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwnj8"]
Sep 09 23:07:14.828058 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.828009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:14.830245 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.830221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 23:07:14.830363 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.830263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 23:07:14.830363 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.830296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d4hxc\""
Sep 09 23:07:14.840162 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.840140    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9knhx"]
Sep 09 23:07:14.840279 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.840183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwnj8"]
Sep 09 23:07:14.840279 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.840223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:14.842897 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.842683    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 23:07:14.842897 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.842760    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 23:07:14.842897 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.842791    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7cr8c\""
Sep 09 23:07:14.842897 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.842800    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 23:07:14.959273 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d254c16-5057-415c-914d-dafc2bcc33b1-config-volume\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:14.959578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtkj\" (UniqueName: \"kubernetes.io/projected/3d254c16-5057-415c-914d-dafc2bcc33b1-kube-api-access-8jtkj\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:14.959578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6xq\" (UniqueName: \"kubernetes.io/projected/bf2fd60d-6a70-43fb-9180-f46fdc89a905-kube-api-access-tg6xq\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:14.959578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d254c16-5057-415c-914d-dafc2bcc33b1-tmp-dir\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:14.959578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf2fd60d-6a70-43fb-9180-f46fdc89a905-cert\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:14.959578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:14.959374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060005 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.059950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d254c16-5057-415c-914d-dafc2bcc33b1-config-volume\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060005 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.059991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtkj\" (UniqueName: \"kubernetes.io/projected/3d254c16-5057-415c-914d-dafc2bcc33b1-kube-api-access-8jtkj\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6xq\" (UniqueName: \"kubernetes.io/projected/bf2fd60d-6a70-43fb-9180-f46fdc89a905-kube-api-access-tg6xq\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:15.060174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d254c16-5057-415c-914d-dafc2bcc33b1-tmp-dir\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf2fd60d-6a70-43fb-9180-f46fdc89a905-cert\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:15.060174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060174 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.060160    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:15.060411 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.060211    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:15.560195762 +0000 UTC m=+34.167805415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:15.060470 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d254c16-5057-415c-914d-dafc2bcc33b1-tmp-dir\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.060548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.060528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d254c16-5057-415c-914d-dafc2bcc33b1-config-volume\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.063884 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.063867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf2fd60d-6a70-43fb-9180-f46fdc89a905-cert\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:15.067453 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.067427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtkj\" (UniqueName: \"kubernetes.io/projected/3d254c16-5057-415c-914d-dafc2bcc33b1-kube-api-access-8jtkj\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.067563 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.067546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6xq\" (UniqueName: \"kubernetes.io/projected/bf2fd60d-6a70-43fb-9180-f46fdc89a905-kube-api-access-tg6xq\") pod \"ingress-canary-vwnj8\" (UID: \"bf2fd60d-6a70-43fb-9180-f46fdc89a905\") " pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:15.149588 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.149572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwnj8"
Sep 09 23:07:15.463399 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.463277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:15.463511 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.463418    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:07:15.463511 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.463447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:15.463511 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.463474    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:47.463460632 +0000 UTC m=+66.071070282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:07:15.463659 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.463535    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:07:15.463659 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.463592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret podName:edb270ef-73e9-4ffe-b404-10113db3a147 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:47.463576517 +0000 UTC m=+66.071186156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret") pod "global-pull-secret-syncer-bvw4w" (UID: "edb270ef-73e9-4ffe-b404-10113db3a147") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:07:15.564360 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.564332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.564372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564472    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564482    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564496    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564505    2578 projected.go:196] Error preparing data for projected volume kube-api-access-2rhzw for pod openshift-network-diagnostics/network-check-target-z8nk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564531    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:16.564516653 +0000 UTC m=+35.172126306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:15.564560 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:15.564547    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw podName:6a326875-07e6-4260-a98d-15183bf9481b nodeName:}" failed. No retries permitted until 2026-09-09 23:07:47.56453863 +0000 UTC m=+66.172148267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2rhzw" (UniqueName: "kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw") pod "network-check-target-z8nk4" (UID: "6a326875-07e6-4260-a98d-15183bf9481b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:07:15.610105 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.610083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwnj8"]
Sep 09 23:07:15.621821 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:07:15.621792    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2fd60d_6a70_43fb_9180_f46fdc89a905.slice/crio-ec2e8ddbc2cc4f9368649cb19cff2215c0418cadfbeee2aa3b22d9f8c0d166f1 WatchSource:0}: Error finding container ec2e8ddbc2cc4f9368649cb19cff2215c0418cadfbeee2aa3b22d9f8c0d166f1: Status 404 returned error can't find the container with id ec2e8ddbc2cc4f9368649cb19cff2215c0418cadfbeee2aa3b22d9f8c0d166f1
Sep 09 23:07:15.945941 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.945879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:15.945941 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.945896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:15.945941 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.945896    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:15.948096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.948072    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:07:15.948217 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.948098    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:07:15.948217 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.948125    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:07:15.948489 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.948472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:07:15.949193 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.949161    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t7jc8\""
Sep 09 23:07:15.949193 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:15.949163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h952m\""
Sep 09 23:07:16.148837 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:16.148804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwnj8" event={"ID":"bf2fd60d-6a70-43fb-9180-f46fdc89a905","Type":"ContainerStarted","Data":"ec2e8ddbc2cc4f9368649cb19cff2215c0418cadfbeee2aa3b22d9f8c0d166f1"}
Sep 09 23:07:16.152049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:16.152024    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="d37962282f506e2e7140c7bd8c67a5b0b33cc8d8a0668ac69ab23bfd23328b2c" exitCode=0
Sep 09 23:07:16.152172 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:16.152061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"d37962282f506e2e7140c7bd8c67a5b0b33cc8d8a0668ac69ab23bfd23328b2c"}
Sep 09 23:07:16.572805 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:16.572735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:16.572925 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:16.572887    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:16.572980 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:16.572959    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:18.572938852 +0000 UTC m=+37.180548508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:17.157726 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:17.157690    2578 generic.go:356] "Generic (PLEG): container finished" podID="d85130e3-071d-454d-9199-3125c46a4ebc" containerID="a748879d301488d0695eec9598d0eeeaa313011dbe76d548b7b5146b1ce4de16" exitCode=0
Sep 09 23:07:17.158229 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:17.157748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerDied","Data":"a748879d301488d0695eec9598d0eeeaa313011dbe76d548b7b5146b1ce4de16"}
Sep 09 23:07:18.163770 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:18.163732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" event={"ID":"d85130e3-071d-454d-9199-3125c46a4ebc","Type":"ContainerStarted","Data":"97551bf5c1244f13152e596fac552ea2c9e7917707a96e629786ca74e50749e9"}
Sep 09 23:07:18.165206 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:18.165175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwnj8" event={"ID":"bf2fd60d-6a70-43fb-9180-f46fdc89a905","Type":"ContainerStarted","Data":"16c5d03d7580c8af2afd861f805c2ee079916412c96986f2903f08f45ab77979"}
Sep 09 23:07:18.186154 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:18.186082    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nsmgq" podStartSLOduration=8.440120027 podStartE2EDuration="36.186066173s" totalImagesPullingTime="27.745946146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:18.18435038 +0000 UTC m=+36.791960039" watchObservedRunningTime="2026-09-09 23:07:18.186066173 +0000 UTC m=+36.793675835"
Sep 09 23:07:18.197854 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:18.197817    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwnj8" podStartSLOduration=1.872569113 podStartE2EDuration="4.197809153s" totalImagesPullingTime="2.32524004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:18.197226095 +0000 UTC m=+36.804835773" watchObservedRunningTime="2026-09-09 23:07:18.197809153 +0000 UTC m=+36.805418811"
Sep 09 23:07:18.586554 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:18.586524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:18.586672 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:18.586655    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:18.586725 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:18.586714    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:22.58669704 +0000 UTC m=+41.194306678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:22.606912 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:22.606881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:22.607265 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:22.607015    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:22.607265 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:22.607069    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:30.607052407 +0000 UTC m=+49.214662053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:30.654128 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:30.654083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:30.654503 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:30.654196    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:30.654503 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:30.654243    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:07:46.654230079 +0000 UTC m=+65.261839716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:41.145573 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:41.145546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vgrqf"
Sep 09 23:07:46.753938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:46.753906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:07:46.754391 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:46.754007    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:07:46.754391 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:46.754062    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:18.754049995 +0000 UTC m=+97.361659632 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:07:47.560172 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.560134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:07:47.560339 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.560183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:47.562451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.562431    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:07:47.562593 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.562577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:07:47.571292 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:47.571273    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:07:47.571342 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:07:47.571327    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:51.571313626 +0000 UTC m=+130.178923263 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : secret "metrics-daemon-secret" not found
Sep 09 23:07:47.574022 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.574006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/edb270ef-73e9-4ffe-b404-10113db3a147-original-pull-secret\") pod \"global-pull-secret-syncer-bvw4w\" (UID: \"edb270ef-73e9-4ffe-b404-10113db3a147\") " pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:47.661283 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.661256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:47.663445 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.663430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:07:47.674168 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.674151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:07:47.684865 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.684846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rhzw\" (UniqueName: \"kubernetes.io/projected/6a326875-07e6-4260-a98d-15183bf9481b-kube-api-access-2rhzw\") pod \"network-check-target-z8nk4\" (UID: \"6a326875-07e6-4260-a98d-15183bf9481b\") " pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:47.757859 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.757840    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t7jc8\""
Sep 09 23:07:47.760451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.760438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bvw4w"
Sep 09 23:07:47.765922 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:47.765906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:48.026427 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:48.026402    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z8nk4"]
Sep 09 23:07:48.029642 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:48.029619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bvw4w"]
Sep 09 23:07:48.030015 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:07:48.029996    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a326875_07e6_4260_a98d_15183bf9481b.slice/crio-3a5124dae30981b172de2762eb9e4df16a2e7a1d14c515a0c1e619f635f9d1d5 WatchSource:0}: Error finding container 3a5124dae30981b172de2762eb9e4df16a2e7a1d14c515a0c1e619f635f9d1d5: Status 404 returned error can't find the container with id 3a5124dae30981b172de2762eb9e4df16a2e7a1d14c515a0c1e619f635f9d1d5
Sep 09 23:07:48.032599 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:07:48.032574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb270ef_73e9_4ffe_b404_10113db3a147.slice/crio-3291a878e37b23cc1c0120a00f54033c019838e4cf280454ae89777ca6bd2420 WatchSource:0}: Error finding container 3291a878e37b23cc1c0120a00f54033c019838e4cf280454ae89777ca6bd2420: Status 404 returned error can't find the container with id 3291a878e37b23cc1c0120a00f54033c019838e4cf280454ae89777ca6bd2420
Sep 09 23:07:48.229456 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:48.229427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8nk4" event={"ID":"6a326875-07e6-4260-a98d-15183bf9481b","Type":"ContainerStarted","Data":"3a5124dae30981b172de2762eb9e4df16a2e7a1d14c515a0c1e619f635f9d1d5"}
Sep 09 23:07:48.230444 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:48.230423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvw4w" event={"ID":"edb270ef-73e9-4ffe-b404-10113db3a147","Type":"ContainerStarted","Data":"3291a878e37b23cc1c0120a00f54033c019838e4cf280454ae89777ca6bd2420"}
Sep 09 23:07:53.244860 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:53.244830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z8nk4" event={"ID":"6a326875-07e6-4260-a98d-15183bf9481b","Type":"ContainerStarted","Data":"c9dfa9af220d32afa83609b56938df1cebbd9d7e7ebc594bd0a26c5c3177bba2"}
Sep 09 23:07:53.245294 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:53.244900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:07:53.246266 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:53.246248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bvw4w" event={"ID":"edb270ef-73e9-4ffe-b404-10113db3a147","Type":"ContainerStarted","Data":"694df4fe9090aca71e623233b426ceaa2e835fbb8bca057cff887eb3e0b80336"}
Sep 09 23:07:53.259825 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:53.259777    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z8nk4" podStartSLOduration=66.578038548 podStartE2EDuration="1m11.259764417s" totalImagesPullingTime="4.681725869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:53.258901229 +0000 UTC m=+71.866510888" watchObservedRunningTime="2026-09-09 23:07:53.259764417 +0000 UTC m=+71.867374080"
Sep 09 23:07:53.272853 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:07:53.272816    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bvw4w" podStartSLOduration=66.590839642 podStartE2EDuration="1m11.272804359s" totalImagesPullingTime="4.681964717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:07:53.272138392 +0000 UTC m=+71.879748055" watchObservedRunningTime="2026-09-09 23:07:53.272804359 +0000 UTC m=+71.880414017"
Sep 09 23:08:18.851726 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:18.851697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:08:18.852065 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:08:18.851806    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:08:18.852065 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:08:18.851863    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:22.851849274 +0000 UTC m=+161.459458924 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:08:24.250564 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:24.250536    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z8nk4"
Sep 09 23:08:51.644963 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:51.644934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:08:51.645405 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:08:51.645045    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:08:51.645405 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:08:51.645092    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:53.645079094 +0000 UTC m=+252.252688744 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : secret "metrics-daemon-secret" not found
Sep 09 23:08:56.413600 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.413564    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"]
Sep 09 23:08:56.415413 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.415398    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"]
Sep 09 23:08:56.415537 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.415522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.417170 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.417152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.417810 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.417794    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 23:08:56.417810 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.417802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 23:08:56.417930 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.417829    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 23:08:56.418298 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.418283    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 23:08:56.419224 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.419204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 09 23:08:56.419404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.419379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 09 23:08:56.419404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.419402    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 09 23:08:56.419544 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.419433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 09 23:08:56.427315 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.427290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"]
Sep 09 23:08:56.432373 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.431165    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"]
Sep 09 23:08:56.471588 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz99z\" (UniqueName: \"kubernetes.io/projected/8f048354-6404-4f84-92c4-76355e7a11c3-kube-api-access-pz99z\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.471588 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.471717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.471717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.471717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f048354-6404-4f84-92c4-76355e7a11c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.471717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.471836 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l4d8\" (UniqueName: \"kubernetes.io/projected/efcc8538-3779-4424-a81a-e4ab8608b9f9-kube-api-access-8l4d8\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.471836 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f048354-6404-4f84-92c4-76355e7a11c3-tmp\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.471836 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.471782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcc8538-3779-4424-a81a-e4ab8608b9f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572231 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz99z\" (UniqueName: \"kubernetes.io/projected/8f048354-6404-4f84-92c4-76355e7a11c3-kube-api-access-pz99z\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.572291 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572291 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572291 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572442 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f048354-6404-4f84-92c4-76355e7a11c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.572442 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572442 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l4d8\" (UniqueName: \"kubernetes.io/projected/efcc8538-3779-4424-a81a-e4ab8608b9f9-kube-api-access-8l4d8\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572587 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f048354-6404-4f84-92c4-76355e7a11c3-tmp\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.572587 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcc8538-3779-4424-a81a-e4ab8608b9f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.572838 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.572822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f048354-6404-4f84-92c4-76355e7a11c3-tmp\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.573230 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.573208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/efcc8538-3779-4424-a81a-e4ab8608b9f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.574676 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.574657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-ca\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.574787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.574770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.574979 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.574960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.575221 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.575201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/efcc8538-3779-4424-a81a-e4ab8608b9f9-hub\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.575261 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.575244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8f048354-6404-4f84-92c4-76355e7a11c3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.580363 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.580343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz99z\" (UniqueName: \"kubernetes.io/projected/8f048354-6404-4f84-92c4-76355e7a11c3-kube-api-access-pz99z\") pod \"klusterlet-addon-workmgr-6478df9b95-bmb65\" (UID: \"8f048354-6404-4f84-92c4-76355e7a11c3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.580600 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.580575    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l4d8\" (UniqueName: \"kubernetes.io/projected/efcc8538-3779-4424-a81a-e4ab8608b9f9-kube-api-access-8l4d8\") pod \"cluster-proxy-proxy-agent-697656fd7d-48dss\" (UID: \"efcc8538-3779-4424-a81a-e4ab8608b9f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.725410 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.725381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:08:56.739636 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.739617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:08:56.989315 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:56.989250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"]
Sep 09 23:08:56.993936 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:08:56.993864    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f048354_6404_4f84_92c4_76355e7a11c3.slice/crio-917bfeae75650e1d5ba32206e7e7bd9d3335ce8d3373d3e045642ef24d6e95ce WatchSource:0}: Error finding container 917bfeae75650e1d5ba32206e7e7bd9d3335ce8d3373d3e045642ef24d6e95ce: Status 404 returned error can't find the container with id 917bfeae75650e1d5ba32206e7e7bd9d3335ce8d3373d3e045642ef24d6e95ce
Sep 09 23:08:57.012439 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:57.012417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"]
Sep 09 23:08:57.015068 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:08:57.015041    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefcc8538_3779_4424_a81a_e4ab8608b9f9.slice/crio-e798a07f9e75eb1cc94e054fbe4c395e288fbf0c16e2f521151cd8148ca0efc0 WatchSource:0}: Error finding container e798a07f9e75eb1cc94e054fbe4c395e288fbf0c16e2f521151cd8148ca0efc0: Status 404 returned error can't find the container with id e798a07f9e75eb1cc94e054fbe4c395e288fbf0c16e2f521151cd8148ca0efc0
Sep 09 23:08:57.384669 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:57.384606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerStarted","Data":"e798a07f9e75eb1cc94e054fbe4c395e288fbf0c16e2f521151cd8148ca0efc0"}
Sep 09 23:08:57.385553 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:08:57.385533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" event={"ID":"8f048354-6404-4f84-92c4-76355e7a11c3","Type":"ContainerStarted","Data":"917bfeae75650e1d5ba32206e7e7bd9d3335ce8d3373d3e045642ef24d6e95ce"}
Sep 09 23:09:02.403472 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.403398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" event={"ID":"8f048354-6404-4f84-92c4-76355e7a11c3","Type":"ContainerStarted","Data":"1b8459dc6b4d96318251345f30cd1f79e88d59693e7b5b552872c2acbbfb3ec6"}
Sep 09 23:09:02.403814 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.403606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:09:02.404809 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.404787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:09:02.405654 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.405632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerStarted","Data":"684146709be7893ff048004bdcb7c1d414e2164e3336f1e748a5dfcc31365148"}
Sep 09 23:09:02.405774 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.405663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerStarted","Data":"1f03c6d5a6710cca02adb462959eb3d23f1adbe4651ea41dfffaae72fd834166"}
Sep 09 23:09:02.405774 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.405675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerStarted","Data":"428e2183a6be852fab63c4a06b550ad66ba54118f9ba60e984c181f41bd5be38"}
Sep 09 23:09:02.417836 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.417788    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" podStartSLOduration=1.30041169 podStartE2EDuration="6.417772756s" totalImagesPullingTime="5.117361066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:02.417377134 +0000 UTC m=+141.024986793" watchObservedRunningTime="2026-09-09 23:09:02.417772756 +0000 UTC m=+141.025382416"
Sep 09 23:09:02.448981 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:02.448943    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" podStartSLOduration=1.354403201 podStartE2EDuration="6.448931691s" totalImagesPullingTime="5.09452849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:02.447717436 +0000 UTC m=+141.055327095" watchObservedRunningTime="2026-09-09 23:09:02.448931691 +0000 UTC m=+141.056541384"
Sep 09 23:09:17.837800 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:09:17.837764    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9knhx" podUID="3d254c16-5057-415c-914d-dafc2bcc33b1"
Sep 09 23:09:18.446064 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:18.446040    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:09:18.965082 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:09:18.965051    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:09:22.941755 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:22.941724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:09:22.942101 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:09:22.941818    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:22.942101 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:09:22.941863    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls podName:3d254c16-5057-415c-914d-dafc2bcc33b1 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:24.941851707 +0000 UTC m=+283.549461357 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls") pod "dns-default-9knhx" (UID: "3d254c16-5057-415c-914d-dafc2bcc33b1") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:31.948332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:09:31.948299    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:10:49.622007 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.621974    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2gqc7"]
Sep 09 23:10:49.623917 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.623892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.626102 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.626081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 23:10:49.626199 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.626134    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 23:10:49.626811 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.626796    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 23:10:49.626853 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.626798    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdjwn\""
Sep 09 23:10:49.626853 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.626831    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 23:10:49.636077 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.636060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2gqc7"]
Sep 09 23:10:49.773165 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.773141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/261cffcd-e4c2-4774-adc3-c70f6c1991a6-data-volume\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.773262 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.773176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgrq\" (UniqueName: \"kubernetes.io/projected/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-api-access-jsgrq\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.773262 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.773211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/261cffcd-e4c2-4774-adc3-c70f6c1991a6-crio-socket\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.773334 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.773260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.773334 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.773282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874448 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/261cffcd-e4c2-4774-adc3-c70f6c1991a6-data-volume\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874448 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgrq\" (UniqueName: \"kubernetes.io/projected/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-api-access-jsgrq\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874448 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/261cffcd-e4c2-4774-adc3-c70f6c1991a6-crio-socket\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874624 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874473    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874624 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874624 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/261cffcd-e4c2-4774-adc3-c70f6c1991a6-crio-socket\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.874624 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:49.874559    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:49.874624 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:49.874580    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:49.874773 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:49.874629    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:50.374611746 +0000 UTC m=+248.982221384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:49.874773 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:49.874653    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:50.374643579 +0000 UTC m=+248.982253217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:49.874773 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.874678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/261cffcd-e4c2-4774-adc3-c70f6c1991a6-data-volume\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:49.881716 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:49.881691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgrq\" (UniqueName: \"kubernetes.io/projected/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-api-access-jsgrq\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:50.377011 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:50.376990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:50.377148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:50.377015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:50.377148 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:50.377090    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:50.377148 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:50.377093    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:50.377263 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:50.377163    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:51.377150792 +0000 UTC m=+249.984760430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:50.377263 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:50.377177    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:51.377170688 +0000 UTC m=+249.984780325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:51.384325 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:51.384300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:51.384325 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:51.384327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:51.384674 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:51.384405    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:51.384674 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:51.384449    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:51.384674 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:51.384462    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:53.384446761 +0000 UTC m=+251.992056410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:51.384674 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:51.384481    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:53.384471657 +0000 UTC m=+251.992081306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:51.787650 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:51.787630    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t9wcg_d586165e-169f-46fd-ae66-088ce2cfd7f4/dns-node-resolver/0.log"
Sep 09 23:10:52.388147 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:52.388122    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cd426_830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf/node-ca/0.log"
Sep 09 23:10:53.387806 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:53.387760    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwnj8_bf2fd60d-6a70-43fb-9180-f46fdc89a905/serve-healthcheck-canary/0.log"
Sep 09 23:10:53.398903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:53.398880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:53.399184 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:53.398907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:53.399184 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.398983    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:53.399184 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.399020    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:53.399184 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.399041    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:57.399028311 +0000 UTC m=+256.006637948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:53.399184 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.399067    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:57.399057834 +0000 UTC m=+256.006667471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:53.701182 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:53.701127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:10:53.701279 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.701247    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:10:53.701315 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:53.701293    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs podName:cb517cf6-6b04-4901-bc1d-4b37f5302657 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:55.701280509 +0000 UTC m=+374.308890146 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs") pod "network-metrics-daemon-dkvjn" (UID: "cb517cf6-6b04-4901-bc1d-4b37f5302657") : secret "metrics-daemon-secret" not found
Sep 09 23:10:57.427467 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:57.427440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:57.427467 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:10:57.427470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:10:57.427910 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:57.427547    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:57.427910 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:57.427548    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:57.427910 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:57.427591    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:05.427578556 +0000 UTC m=+264.035188194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:57.427910 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:10:57.427605    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:05.427598478 +0000 UTC m=+264.035208115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : configmap "kube-rbac-proxy" not found
Sep 09 23:11:02.403758 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:02.403722    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" podUID="8f048354-6404-4f84-92c4-76355e7a11c3" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Sep 09 23:11:02.719906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:02.719878    2578 generic.go:356] "Generic (PLEG): container finished" podID="8f048354-6404-4f84-92c4-76355e7a11c3" containerID="1b8459dc6b4d96318251345f30cd1f79e88d59693e7b5b552872c2acbbfb3ec6" exitCode=1
Sep 09 23:11:02.720021 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:02.719931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" event={"ID":"8f048354-6404-4f84-92c4-76355e7a11c3","Type":"ContainerDied","Data":"1b8459dc6b4d96318251345f30cd1f79e88d59693e7b5b552872c2acbbfb3ec6"}
Sep 09 23:11:02.720198 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:02.720186    2578 scope.go:117] "RemoveContainer" containerID="1b8459dc6b4d96318251345f30cd1f79e88d59693e7b5b552872c2acbbfb3ec6"
Sep 09 23:11:03.724347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:03.724313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65" event={"ID":"8f048354-6404-4f84-92c4-76355e7a11c3","Type":"ContainerStarted","Data":"f8bbde842ca1fc7fcf58f1df613bd41ffb683123fe5ee7043823e6cb12db0476"}
Sep 09 23:11:03.724730 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:03.724590    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:11:03.725081 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:03.725063    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6478df9b95-bmb65"
Sep 09 23:11:05.482548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:05.482479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:05.482548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:05.482508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:05.482906 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:05.482601    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:11:05.482906 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:05.482652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls podName:261cffcd-e4c2-4774-adc3-c70f6c1991a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:21.482635858 +0000 UTC m=+280.090245514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2gqc7" (UID: "261cffcd-e4c2-4774-adc3-c70f6c1991a6") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:11:05.482977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:05.482942    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/261cffcd-e4c2-4774-adc3-c70f6c1991a6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:12.771963 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.771930    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d969b696f-w4lhl"]
Sep 09 23:11:12.773577 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.773562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.777198 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.777172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 23:11:12.777328 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.777206    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 23:11:12.777328 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.777262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 23:11:12.777528 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.777511    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9f5w\""
Sep 09 23:11:12.783583 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.783566    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 23:11:12.788205 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.788186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d969b696f-w4lhl"]
Sep 09 23:11:12.928601 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-installation-pull-secrets\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928699 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnbk\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-kube-api-access-prnbk\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928749 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-trusted-ca\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-bound-sa-token\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-image-registry-private-configuration\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-tls\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-certificates\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:12.928879 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:12.928858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-ca-trust-extracted\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029494 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-tls\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029494 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-certificates\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029634 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-ca-trust-extracted\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029634 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-installation-pull-secrets\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029634 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnbk\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-kube-api-access-prnbk\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029777 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-trusted-ca\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029777 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-bound-sa-token\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029777 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-image-registry-private-configuration\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.029984 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.029947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-ca-trust-extracted\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.030332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.030309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-certificates\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.030841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.030706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-trusted-ca\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.031925 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.031900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-registry-tls\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.031998 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.031938    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-image-registry-private-configuration\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.032039 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.032010    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-installation-pull-secrets\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.037891 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.037869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnbk\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-kube-api-access-prnbk\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.038163 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.038144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8b0249c-bdb5-4e05-b143-7cd3e35c83dd-bound-sa-token\") pod \"image-registry-5d969b696f-w4lhl\" (UID: \"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd\") " pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.082036 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.082014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.348169 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.347362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d969b696f-w4lhl"]
Sep 09 23:11:13.351913 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:11:13.351884    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b0249c_bdb5_4e05_b143_7cd3e35c83dd.slice/crio-eeb4349361eee38584f0ecba40d94903576892b2275d01479cb73096a8af2f22 WatchSource:0}: Error finding container eeb4349361eee38584f0ecba40d94903576892b2275d01479cb73096a8af2f22: Status 404 returned error can't find the container with id eeb4349361eee38584f0ecba40d94903576892b2275d01479cb73096a8af2f22
Sep 09 23:11:13.751181 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.751150    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" event={"ID":"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd","Type":"ContainerStarted","Data":"8746403556fcd2559400ad18905d10b010d257abbbb6bca148864f9b252b0dcb"}
Sep 09 23:11:13.751332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.751198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" event={"ID":"d8b0249c-bdb5-4e05-b143-7cd3e35c83dd","Type":"ContainerStarted","Data":"eeb4349361eee38584f0ecba40d94903576892b2275d01479cb73096a8af2f22"}
Sep 09 23:11:13.751332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.751316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:13.769839 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:13.769794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" podStartSLOduration=1.769779578 podStartE2EDuration="1.769779578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:11:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:13.768787307 +0000 UTC m=+272.376396965" watchObservedRunningTime="2026-09-09 23:11:13.769779578 +0000 UTC m=+272.377389236"
Sep 09 23:11:21.446866 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:21.446827    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9knhx" podUID="3d254c16-5057-415c-914d-dafc2bcc33b1"
Sep 09 23:11:21.485163 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:21.485130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:21.487290 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:21.487273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/261cffcd-e4c2-4774-adc3-c70f6c1991a6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2gqc7\" (UID: \"261cffcd-e4c2-4774-adc3-c70f6c1991a6\") " pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:21.732602 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:21.732583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2gqc7"
Sep 09 23:11:21.773188 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:21.773165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:21.997682 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:21.997624    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2gqc7"]
Sep 09 23:11:22.000204 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:11:22.000178    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261cffcd_e4c2_4774_adc3_c70f6c1991a6.slice/crio-c1d34a7e95589b5a2be5c51105d999834952aed5cb99e7c4bb74af43fd092e43 WatchSource:0}: Error finding container c1d34a7e95589b5a2be5c51105d999834952aed5cb99e7c4bb74af43fd092e43: Status 404 returned error can't find the container with id c1d34a7e95589b5a2be5c51105d999834952aed5cb99e7c4bb74af43fd092e43
Sep 09 23:11:22.776985 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:22.776957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2gqc7" event={"ID":"261cffcd-e4c2-4774-adc3-c70f6c1991a6","Type":"ContainerStarted","Data":"e9638c3e4cd6101fce63f936a41d0f7bda2dde473114be5ad10b89e0ccde7798"}
Sep 09 23:11:22.777266 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:22.777007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2gqc7" event={"ID":"261cffcd-e4c2-4774-adc3-c70f6c1991a6","Type":"ContainerStarted","Data":"212eb88fef85dbf5a610f3b9551ff9507b76fa7fe55dc3f2d6c93498735ef761"}
Sep 09 23:11:22.777266 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:22.777024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2gqc7" event={"ID":"261cffcd-e4c2-4774-adc3-c70f6c1991a6","Type":"ContainerStarted","Data":"c1d34a7e95589b5a2be5c51105d999834952aed5cb99e7c4bb74af43fd092e43"}
Sep 09 23:11:24.784635 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:24.784610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2gqc7" event={"ID":"261cffcd-e4c2-4774-adc3-c70f6c1991a6","Type":"ContainerStarted","Data":"56642977e755495d443bb77048b5c2bcefb9714c6757147bea688619a3d14e4a"}
Sep 09 23:11:24.801921 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:24.801886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2gqc7" podStartSLOduration=33.737410014 podStartE2EDuration="35.801871185s" totalImagesPullingTime="2.064461171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:10:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:24.80048792 +0000 UTC m=+283.408097597" watchObservedRunningTime="2026-09-09 23:11:24.801871185 +0000 UTC m=+283.409480843"
Sep 09 23:11:25.005316 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.005290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:25.007248 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.007230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d254c16-5057-415c-914d-dafc2bcc33b1-metrics-tls\") pod \"dns-default-9knhx\" (UID: \"3d254c16-5057-415c-914d-dafc2bcc33b1\") " pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:25.076638 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.076595    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d4hxc\""
Sep 09 23:11:25.085262 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.085247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:25.350227 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.348385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9knhx"]
Sep 09 23:11:25.353696 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:11:25.353669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d254c16_5057_415c_914d_dafc2bcc33b1.slice/crio-e4b5ad1868a230c8e74142c1a0eddb4fe5ae90c5eb565eba931ecd1114691e1d WatchSource:0}: Error finding container e4b5ad1868a230c8e74142c1a0eddb4fe5ae90c5eb565eba931ecd1114691e1d: Status 404 returned error can't find the container with id e4b5ad1868a230c8e74142c1a0eddb4fe5ae90c5eb565eba931ecd1114691e1d
Sep 09 23:11:25.788038 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:25.788008    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9knhx" event={"ID":"3d254c16-5057-415c-914d-dafc2bcc33b1","Type":"ContainerStarted","Data":"e4b5ad1868a230c8e74142c1a0eddb4fe5ae90c5eb565eba931ecd1114691e1d"}
Sep 09 23:11:27.795325 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:27.795296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9knhx" event={"ID":"3d254c16-5057-415c-914d-dafc2bcc33b1","Type":"ContainerStarted","Data":"a5105e680a4ee702508d140dce5f389e79c0d156bcaa0f77ab6f7c5e49ca477b"}
Sep 09 23:11:27.795726 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:27.795341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9knhx" event={"ID":"3d254c16-5057-415c-914d-dafc2bcc33b1","Type":"ContainerStarted","Data":"043bbcf77c212d60ea16e4f4aa6f63dd0cb43c7c10c7ad2c54e4591150ea8c25"}
Sep 09 23:11:27.795726 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:27.795516    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:27.812987 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:27.812944    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9knhx" podStartSLOduration=252.185618473 podStartE2EDuration="4m13.81293193s" totalImagesPullingTime="1.627313457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:27.812348688 +0000 UTC m=+286.419958351" watchObservedRunningTime="2026-09-09 23:11:27.81293193 +0000 UTC m=+286.420541589"
Sep 09 23:11:33.086045 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:33.086016    2578 patch_prober.go:28] interesting pod/image-registry-5d969b696f-w4lhl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 23:11:33.086535 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:33.086061    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" podUID="d8b0249c-bdb5-4e05-b143-7cd3e35c83dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:11:34.759317 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:34.759288    2578 patch_prober.go:28] interesting pod/image-registry-5d969b696f-w4lhl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 23:11:34.759641 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:34.759331    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" podUID="d8b0249c-bdb5-4e05-b143-7cd3e35c83dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:11:34.949529 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:34.949491    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dkvjn" podUID="cb517cf6-6b04-4901-bc1d-4b37f5302657"
Sep 09 23:11:36.740869 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:36.740831    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" podUID="efcc8538-3779-4424-a81a-e4ab8608b9f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:11:37.799869 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:37.799840    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9knhx"
Sep 09 23:11:38.583812 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.583786    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fbnm8"]
Sep 09 23:11:38.589046 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.589029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.591223 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.591174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 23:11:38.591482 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.591467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 23:11:38.591537 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.591486    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:11:38.592346 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.592327    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:11:38.592447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.592357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:11:38.592447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.592357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 23:11:38.592639 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.592623    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d8l4b\""
Sep 09 23:11:38.687632 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687741 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-textfile\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687741 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687741 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nbnl\" (UniqueName: \"kubernetes.io/projected/60561de0-3f36-4ba9-9b60-5ea01635aae6-kube-api-access-5nbnl\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687845 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-wtmp\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687845 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-metrics-client-ca\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687845 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-sys\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687943 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-root\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.687943 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.687887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789132 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-textfile\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789226 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789226 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nbnl\" (UniqueName: \"kubernetes.io/projected/60561de0-3f36-4ba9-9b60-5ea01635aae6-kube-api-access-5nbnl\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789226 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-wtmp\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789366 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:38.789241    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 23:11:38.789366 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-metrics-client-ca\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789366 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:11:38.789298    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls podName:60561de0-3f36-4ba9-9b60-5ea01635aae6 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:39.2892814 +0000 UTC m=+297.896891037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls") pod "node-exporter-fbnm8" (UID: "60561de0-3f36-4ba9-9b60-5ea01635aae6") : secret "node-exporter-tls" not found
Sep 09 23:11:38.789366 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-sys\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789366 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-root\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-wtmp\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-root\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60561de0-3f36-4ba9-9b60-5ea01635aae6-sys\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-textfile\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789781 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-metrics-client-ca\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.789899 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.789883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.791608 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.791592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:38.798699 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:38.798677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nbnl\" (UniqueName: \"kubernetes.io/projected/60561de0-3f36-4ba9-9b60-5ea01635aae6-kube-api-access-5nbnl\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:39.293184 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:39.293152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:39.295178 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:39.295158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60561de0-3f36-4ba9-9b60-5ea01635aae6-node-exporter-tls\") pod \"node-exporter-fbnm8\" (UID: \"60561de0-3f36-4ba9-9b60-5ea01635aae6\") " pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:39.497759 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:39.497730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fbnm8"
Sep 09 23:11:39.508468 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:11:39.508448    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60561de0_3f36_4ba9_9b60_5ea01635aae6.slice/crio-98562bd054635cdabab4a348d0d7e3a37902a78e6e6ce2360da0999999722807 WatchSource:0}: Error finding container 98562bd054635cdabab4a348d0d7e3a37902a78e6e6ce2360da0999999722807: Status 404 returned error can't find the container with id 98562bd054635cdabab4a348d0d7e3a37902a78e6e6ce2360da0999999722807
Sep 09 23:11:39.834412 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:39.834389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbnm8" event={"ID":"60561de0-3f36-4ba9-9b60-5ea01635aae6","Type":"ContainerStarted","Data":"98562bd054635cdabab4a348d0d7e3a37902a78e6e6ce2360da0999999722807"}
Sep 09 23:11:40.839021 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:40.838997    2578 generic.go:356] "Generic (PLEG): container finished" podID="60561de0-3f36-4ba9-9b60-5ea01635aae6" containerID="df84e0741c3c3e1333c3ca59d916a97074e87a9b9e77dc92f0116c507c248718" exitCode=0
Sep 09 23:11:40.839307 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:40.839064    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbnm8" event={"ID":"60561de0-3f36-4ba9-9b60-5ea01635aae6","Type":"ContainerDied","Data":"df84e0741c3c3e1333c3ca59d916a97074e87a9b9e77dc92f0116c507c248718"}
Sep 09 23:11:41.717335 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:41.717302    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 23:11:41.844681 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:41.844560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbnm8" event={"ID":"60561de0-3f36-4ba9-9b60-5ea01635aae6","Type":"ContainerStarted","Data":"f4f4691b9e57cb524f86494580cb39648b1340eac3eb01d9b5c269d3237bc7a9"}
Sep 09 23:11:41.844681 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:41.844619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbnm8" event={"ID":"60561de0-3f36-4ba9-9b60-5ea01635aae6","Type":"ContainerStarted","Data":"fa9f4e680fde588a447a3ee061a0adfad2f353260e9f02487149765cc87f4bbb"}
Sep 09 23:11:41.862697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:41.862658    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fbnm8" podStartSLOduration=2.896487547 podStartE2EDuration="3.862644386s" totalImagesPullingTime="907.993347ms" totalInitContainerRuntime="58.163492ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:41.861036619 +0000 UTC m=+300.468646296" watchObservedRunningTime="2026-09-09 23:11:41.862644386 +0000 UTC m=+300.470254044"
Sep 09 23:11:42.871158 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.871122    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85dc8dc659-rb6q2"]
Sep 09 23:11:42.874092 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.874072    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:42.876717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.876695    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 23:11:42.876717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.876720    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8tqjt\""
Sep 09 23:11:42.876870 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.876737    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 23:11:42.877877 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.877858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 23:11:42.877988 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.877926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 23:11:42.877988 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.877984    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b7drntn6vv8jm\""
Sep 09 23:11:42.882906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:42.882887    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85dc8dc659-rb6q2"]
Sep 09 23:11:43.018832 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-client-certs\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.018947 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-client-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.018947 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d676a22-eba0-4c58-8fa8-76691ee231bd-audit-log\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.018947 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-tls\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.019074 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqfbg\" (UniqueName: \"kubernetes.io/projected/7d676a22-eba0-4c58-8fa8-76691ee231bd-kube-api-access-hqfbg\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.019074 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.018995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.019170 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.019155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-metrics-server-audit-profiles\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.087212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.087175    2578 patch_prober.go:28] interesting pod/image-registry-5d969b696f-w4lhl container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 23:11:43.087347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.087236    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl" podUID="d8b0249c-bdb5-4e05-b143-7cd3e35c83dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:11:43.119906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.119880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-metrics-server-audit-profiles\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.119911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-client-certs\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.119926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-client-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.119953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d676a22-eba0-4c58-8fa8-76691ee231bd-audit-log\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120190 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-tls\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120190 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqfbg\" (UniqueName: \"kubernetes.io/projected/7d676a22-eba0-4c58-8fa8-76691ee231bd-kube-api-access-hqfbg\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120190 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120348 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d676a22-eba0-4c58-8fa8-76691ee231bd-audit-log\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.120899 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120871    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.121036 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.120992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d676a22-eba0-4c58-8fa8-76691ee231bd-metrics-server-audit-profiles\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.122544 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.122487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-client-certs\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.122636 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.122601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-secret-metrics-server-tls\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.122682 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.122631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d676a22-eba0-4c58-8fa8-76691ee231bd-client-ca-bundle\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.127001 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.126981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqfbg\" (UniqueName: \"kubernetes.io/projected/7d676a22-eba0-4c58-8fa8-76691ee231bd-kube-api-access-hqfbg\") pod \"metrics-server-85dc8dc659-rb6q2\" (UID: \"7d676a22-eba0-4c58-8fa8-76691ee231bd\") " pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.182294 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.182270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:11:43.457224 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.457150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85dc8dc659-rb6q2"]
Sep 09 23:11:43.459604 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:11:43.459578    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d676a22_eba0_4c58_8fa8_76691ee231bd.slice/crio-7dadc8dde0c1ee396dd7a9695ed266d6d7d8764f9947f73dd450174a192f31fc WatchSource:0}: Error finding container 7dadc8dde0c1ee396dd7a9695ed266d6d7d8764f9947f73dd450174a192f31fc: Status 404 returned error can't find the container with id 7dadc8dde0c1ee396dd7a9695ed266d6d7d8764f9947f73dd450174a192f31fc
Sep 09 23:11:43.461567 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.461551    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:11:43.851443 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:43.851381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2" event={"ID":"7d676a22-eba0-4c58-8fa8-76691ee231bd","Type":"ContainerStarted","Data":"7dadc8dde0c1ee396dd7a9695ed266d6d7d8764f9947f73dd450174a192f31fc"}
Sep 09 23:11:44.759627 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:44.759597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d969b696f-w4lhl"
Sep 09 23:11:45.863483 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:45.863446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2" event={"ID":"7d676a22-eba0-4c58-8fa8-76691ee231bd","Type":"ContainerStarted","Data":"a2d80355445f38c13cd94ea47a5ec7070806eaeefa33cd1653a8ef83b763ecbd"}
Sep 09 23:11:45.878469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:45.878422    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2" podStartSLOduration=2.394238981 podStartE2EDuration="3.878404073s" totalImagesPullingTime="1.484165092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:45.877315632 +0000 UTC m=+304.484925291" watchObservedRunningTime="2026-09-09 23:11:45.878404073 +0000 UTC m=+304.486013732"
Sep 09 23:11:46.741379 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:46.741349    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" podUID="efcc8538-3779-4424-a81a-e4ab8608b9f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:11:46.946299 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:46.946276    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:11:56.741548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.741508    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" podUID="efcc8538-3779-4424-a81a-e4ab8608b9f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:11:56.741979 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.741576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss"
Sep 09 23:11:56.742155 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.742097    2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"684146709be7893ff048004bdcb7c1d414e2164e3336f1e748a5dfcc31365148"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 09 23:11:56.742231 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.742181    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" podUID="efcc8538-3779-4424-a81a-e4ab8608b9f9" containerName="service-proxy" containerID="cri-o://684146709be7893ff048004bdcb7c1d414e2164e3336f1e748a5dfcc31365148" gracePeriod=30
Sep 09 23:11:56.897797 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.897773    2578 generic.go:356] "Generic (PLEG): container finished" podID="efcc8538-3779-4424-a81a-e4ab8608b9f9" containerID="684146709be7893ff048004bdcb7c1d414e2164e3336f1e748a5dfcc31365148" exitCode=2
Sep 09 23:11:56.897882 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:56.897840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerDied","Data":"684146709be7893ff048004bdcb7c1d414e2164e3336f1e748a5dfcc31365148"}
Sep 09 23:11:57.903016 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:11:57.902985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-697656fd7d-48dss" event={"ID":"efcc8538-3779-4424-a81a-e4ab8608b9f9","Type":"ContainerStarted","Data":"d1084a5617fcdfcdd08a23285ef8e343e328c4521ff51f0d7f8a9c7d731cc115"}
Sep 09 23:12:03.182979 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:03.182946    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:12:03.183332 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:03.182995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:12:23.187909 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:23.187882    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:12:23.191384 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:23.191362    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85dc8dc659-rb6q2"
Sep 09 23:12:55.777627 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:55.777591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:12:55.779842 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:55.779818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb517cf6-6b04-4901-bc1d-4b37f5302657-metrics-certs\") pod \"network-metrics-daemon-dkvjn\" (UID: \"cb517cf6-6b04-4901-bc1d-4b37f5302657\") " pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:12:55.949603 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:55.949580    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h952m\""
Sep 09 23:12:55.957377 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:55.957358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dkvjn"
Sep 09 23:12:56.224404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:56.224265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dkvjn"]
Sep 09 23:12:56.226906 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:12:56.226878    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb517cf6_6b04_4901_bc1d_4b37f5302657.slice/crio-1bbcaa94cc1f4d660f7d02b3b492c739b697d6c39de53c764cf2f5ee24bd801f WatchSource:0}: Error finding container 1bbcaa94cc1f4d660f7d02b3b492c739b697d6c39de53c764cf2f5ee24bd801f: Status 404 returned error can't find the container with id 1bbcaa94cc1f4d660f7d02b3b492c739b697d6c39de53c764cf2f5ee24bd801f
Sep 09 23:12:57.080248 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:57.080212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkvjn" event={"ID":"cb517cf6-6b04-4901-bc1d-4b37f5302657","Type":"ContainerStarted","Data":"1bbcaa94cc1f4d660f7d02b3b492c739b697d6c39de53c764cf2f5ee24bd801f"}
Sep 09 23:12:58.084933 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:58.084901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkvjn" event={"ID":"cb517cf6-6b04-4901-bc1d-4b37f5302657","Type":"ContainerStarted","Data":"39bfb519fdec541278dc4f6b46d2534c5156d44191913667eba96ddecc69cf59"}
Sep 09 23:12:58.085412 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:58.084959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dkvjn" event={"ID":"cb517cf6-6b04-4901-bc1d-4b37f5302657","Type":"ContainerStarted","Data":"0558fd486c6b8f01459ab8b66e6099c9b9dc04c3dda2ac850ba35e3163fb8e98"}
Sep 09 23:12:58.103570 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:12:58.103516    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dkvjn" podStartSLOduration=375.185185439 podStartE2EDuration="6m16.103499777s" totalImagesPullingTime="918.314338ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:58.103204646 +0000 UTC m=+376.710814307" watchObservedRunningTime="2026-09-09 23:12:58.103499777 +0000 UTC m=+376.711109437"
Sep 09 23:15:38.973906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.973834    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wq9rf"]
Sep 09 23:15:38.975640 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.975622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:38.978219 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.978194    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 23:15:38.978329 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.978218    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 23:15:38.978922 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.978906    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z9z5n\""
Sep 09 23:15:38.985430 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:38.985410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wq9rf"]
Sep 09 23:15:39.016347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.016322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffht\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-kube-api-access-bffht\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.016463 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.016363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-bound-sa-token\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.117766 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.117733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffht\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-kube-api-access-bffht\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.117766 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.117772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-bound-sa-token\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.124777 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.124760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-bound-sa-token\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.124917 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.124902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffht\" (UniqueName: \"kubernetes.io/projected/4e7b260f-aaa1-43a3-b947-25079f9c2a38-kube-api-access-bffht\") pod \"cert-manager-55b4d954d5-wq9rf\" (UID: \"4e7b260f-aaa1-43a3-b947-25079f9c2a38\") " pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.284727 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.284682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-wq9rf"
Sep 09 23:15:39.548808 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.548720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-wq9rf"]
Sep 09 23:15:39.550951 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:15:39.550927    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e7b260f_aaa1_43a3_b947_25079f9c2a38.slice/crio-0ccabcc437b2f0eff1ec1f4541e13749793147a7511ea877a258fc72bc433fd5 WatchSource:0}: Error finding container 0ccabcc437b2f0eff1ec1f4541e13749793147a7511ea877a258fc72bc433fd5: Status 404 returned error can't find the container with id 0ccabcc437b2f0eff1ec1f4541e13749793147a7511ea877a258fc72bc433fd5
Sep 09 23:15:39.571717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:39.571692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wq9rf" event={"ID":"4e7b260f-aaa1-43a3-b947-25079f9c2a38","Type":"ContainerStarted","Data":"0ccabcc437b2f0eff1ec1f4541e13749793147a7511ea877a258fc72bc433fd5"}
Sep 09 23:15:43.586817 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:43.586777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-wq9rf" event={"ID":"4e7b260f-aaa1-43a3-b947-25079f9c2a38","Type":"ContainerStarted","Data":"75cf9bd54afdc98052b8fc05997843b7810be154f6db6d1f38c98fab641ba86a"}
Sep 09 23:15:43.602439 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:15:43.602388    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-wq9rf" podStartSLOduration=2.504946239 podStartE2EDuration="5.602370543s" totalImagesPullingTime="3.097424304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:43.602178038 +0000 UTC m=+542.209787698" watchObservedRunningTime="2026-09-09 23:15:43.602370543 +0000 UTC m=+542.209980209"
Sep 09 23:16:00.316131 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.316080    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"]
Sep 09 23:16:00.318249 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.318228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.320921 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.320899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 23:16:00.321167 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.321151    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 23:16:00.321572 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.321555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 23:16:00.321666 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.321568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wgrm\""
Sep 09 23:16:00.321666 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.321568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 23:16:00.335939 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.335918    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"]
Sep 09 23:16:00.354920 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.354900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.355014 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.354931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.355014 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.354954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gb5p\" (UniqueName: \"kubernetes.io/projected/4592cfee-0251-4ef6-abce-ba20998e97ed-kube-api-access-7gb5p\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.355174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.355025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-tmp\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.355174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.355134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-manifests\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.455895 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.455869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.455990 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.455904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gb5p\" (UniqueName: \"kubernetes.io/projected/4592cfee-0251-4ef6-abce-ba20998e97ed-kube-api-access-7gb5p\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.455990 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.455930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-tmp\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.455990 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.455977    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-manifests\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.456156 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.456029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.456392 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.456368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-manifests\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.458146 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.458125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4592cfee-0251-4ef6-abce-ba20998e97ed-tmp\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.458363 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.458341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.458405 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.458350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4592cfee-0251-4ef6-abce-ba20998e97ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.463208 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.463187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gb5p\" (UniqueName: \"kubernetes.io/projected/4592cfee-0251-4ef6-abce-ba20998e97ed-kube-api-access-7gb5p\") pod \"opendatahub-operator-controller-manager-c5b764bdf-g6tv7\" (UID: \"4592cfee-0251-4ef6-abce-ba20998e97ed\") " pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.627776 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.627730    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:00.902717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:00.902655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"]
Sep 09 23:16:00.906197 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:00.906175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4592cfee_0251_4ef6_abce_ba20998e97ed.slice/crio-30959fac04e6732046ed3550620f6c5d908b92b351db75b817bbbe7d32b1da62 WatchSource:0}: Error finding container 30959fac04e6732046ed3550620f6c5d908b92b351db75b817bbbe7d32b1da62: Status 404 returned error can't find the container with id 30959fac04e6732046ed3550620f6c5d908b92b351db75b817bbbe7d32b1da62
Sep 09 23:16:01.650124 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:01.650074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7" event={"ID":"4592cfee-0251-4ef6-abce-ba20998e97ed","Type":"ContainerStarted","Data":"30959fac04e6732046ed3550620f6c5d908b92b351db75b817bbbe7d32b1da62"}
Sep 09 23:16:04.661217 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:04.661179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7" event={"ID":"4592cfee-0251-4ef6-abce-ba20998e97ed","Type":"ContainerStarted","Data":"14d4c8f8fe7ea7a0e9677b694ca1a69282a73b414ab0744d9a048ac5c2224760"}
Sep 09 23:16:05.666207 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:05.666180    2578 generic.go:356] "Generic (PLEG): container finished" podID="4592cfee-0251-4ef6-abce-ba20998e97ed" containerID="14d4c8f8fe7ea7a0e9677b694ca1a69282a73b414ab0744d9a048ac5c2224760" exitCode=0
Sep 09 23:16:05.666563 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:05.666220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7" event={"ID":"4592cfee-0251-4ef6-abce-ba20998e97ed","Type":"ContainerDied","Data":"14d4c8f8fe7ea7a0e9677b694ca1a69282a73b414ab0744d9a048ac5c2224760"}
Sep 09 23:16:06.670970 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:06.670937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7" event={"ID":"4592cfee-0251-4ef6-abce-ba20998e97ed","Type":"ContainerStarted","Data":"930db48f812dba1ef4a5f2c690d7d403454e3c5003f91d7a30efb696eeb283b3"}
Sep 09 23:16:06.671368 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:06.671090    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:06.691712 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:06.691668    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7" podStartSLOduration=2.569591006 podStartE2EDuration="6.691655686s" totalImagesPullingTime="3.183219104s" totalInitContainerRuntime="938.845576ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:06.689985695 +0000 UTC m=+565.297595355" watchObservedRunningTime="2026-09-09 23:16:06.691655686 +0000 UTC m=+565.299265343"
Sep 09 23:16:17.676527 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:17.676501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c5b764bdf-g6tv7"
Sep 09 23:16:30.353853 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.353820    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"]
Sep 09 23:16:30.368327 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.368297    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"]
Sep 09 23:16:30.368487 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.368402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.370887 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.370867    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bdrbk\""
Sep 09 23:16:30.371201 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.371178    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 23:16:30.371277 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.371198    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 23:16:30.371277 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.371192    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 23:16:30.371874 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.371858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 23:16:30.450764 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.450741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5d8\" (UniqueName: \"kubernetes.io/projected/66401faf-b459-4ca2-80f9-12a87604a534-kube-api-access-pd5d8\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.450837 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.450779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66401faf-b459-4ca2-80f9-12a87604a534-tmp\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.450837 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.450798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66401faf-b459-4ca2-80f9-12a87604a534-tls-certs\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.496823 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.496794    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sdfp4"]
Sep 09 23:16:30.498629 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.498614    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.501527 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.501513    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vw6tr\""
Sep 09 23:16:30.501904 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.501878    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 23:16:30.511102 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.511069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sdfp4"]
Sep 09 23:16:30.551867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.551847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5d8\" (UniqueName: \"kubernetes.io/projected/66401faf-b459-4ca2-80f9-12a87604a534-kube-api-access-pd5d8\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.551977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.551879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66401faf-b459-4ca2-80f9-12a87604a534-tmp\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.551977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.551899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66401faf-b459-4ca2-80f9-12a87604a534-tls-certs\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.553997 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.553975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66401faf-b459-4ca2-80f9-12a87604a534-tmp\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.554230 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.554204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66401faf-b459-4ca2-80f9-12a87604a534-tls-certs\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.558878 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.558856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5d8\" (UniqueName: \"kubernetes.io/projected/66401faf-b459-4ca2-80f9-12a87604a534-kube-api-access-pd5d8\") pod \"kube-auth-proxy-7ddf9d86bc-p28ck\" (UID: \"66401faf-b459-4ca2-80f9-12a87604a534\") " pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.652528 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.652479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.652528 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.652524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktfg\" (UniqueName: \"kubernetes.io/projected/66b92bda-269b-4474-9590-ccaefd26b70d-kube-api-access-zktfg\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.677654 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.677628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"
Sep 09 23:16:30.753842 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.753818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.753955 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.753877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktfg\" (UniqueName: \"kubernetes.io/projected/66b92bda-269b-4474-9590-ccaefd26b70d-kube-api-access-zktfg\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.753999 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:30.753971    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 23:16:30.754043 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:30.754033    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert podName:66b92bda-269b-4474-9590-ccaefd26b70d nodeName:}" failed. No retries permitted until 2026-09-09 23:16:31.254014679 +0000 UTC m=+589.861624342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert") pod "odh-model-controller-7998c67dc4-sdfp4" (UID: "66b92bda-269b-4474-9590-ccaefd26b70d") : secret "odh-model-controller-webhook-cert" not found
Sep 09 23:16:30.761559 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.761539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktfg\" (UniqueName: \"kubernetes.io/projected/66b92bda-269b-4474-9590-ccaefd26b70d-kube-api-access-zktfg\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:30.953933 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:30.953902    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck"]
Sep 09 23:16:30.956058 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:30.956034    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66401faf_b459_4ca2_80f9_12a87604a534.slice/crio-ca15f8be17d34055e3ad3f0b40e9c8fd3b415a155755d78f23993bfb2ce08077 WatchSource:0}: Error finding container ca15f8be17d34055e3ad3f0b40e9c8fd3b415a155755d78f23993bfb2ce08077: Status 404 returned error can't find the container with id ca15f8be17d34055e3ad3f0b40e9c8fd3b415a155755d78f23993bfb2ce08077
Sep 09 23:16:31.169842 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.169808    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gg6x5"]
Sep 09 23:16:31.172388 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.172371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.174632 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.174612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 23:16:31.174717 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.174689    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-ghcn9\""
Sep 09 23:16:31.183813 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.183792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gg6x5"]
Sep 09 23:16:31.257643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.257593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.257643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.257629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:31.257883 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.257708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx5l\" (UniqueName: \"kubernetes.io/projected/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-kube-api-access-ktx5l\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.259760 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.259739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b92bda-269b-4474-9590-ccaefd26b70d-cert\") pod \"odh-model-controller-7998c67dc4-sdfp4\" (UID: \"66b92bda-269b-4474-9590-ccaefd26b70d\") " pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:31.353631 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.353599    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:31.355664 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.355646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.357918 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.357896    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 23:16:31.358034 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.357917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j8fbt\""
Sep 09 23:16:31.358034 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.357930    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 23:16:31.358034 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.357929    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 23:16:31.358260 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.358062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.358260 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.358151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx5l\" (UniqueName: \"kubernetes.io/projected/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-kube-api-access-ktx5l\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.358260 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:31.358174    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 09 23:16:31.358260 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:31.358236    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs podName:9c32e1dd-3e14-426b-9eb6-c8158c91a3a6 nodeName:}" failed. No retries permitted until 2026-09-09 23:16:31.858219177 +0000 UTC m=+590.465828819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs") pod "model-serving-api-54d89bd5fc-gg6x5" (UID: "9c32e1dd-3e14-426b-9eb6-c8158c91a3a6") : secret "model-serving-api-tls" not found
Sep 09 23:16:31.358485 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.358261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 23:16:31.369476 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.369456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:31.372160 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.372138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx5l\" (UniqueName: \"kubernetes.io/projected/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-kube-api-access-ktx5l\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.407737 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.407715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:31.458991 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.458958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459094 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459167 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459204 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459245 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77mdq\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459298 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.459351 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.459335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560599 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560599 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77mdq\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.560787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.560765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.561796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.561772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.563565 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.563521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.563702 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.563667    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.563819 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.563797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.564176 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.564153    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.570212 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.570189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77mdq\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.570412 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.570392    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4cqxz\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.664803 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.664743    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:31.673506 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.673479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sdfp4"]
Sep 09 23:16:31.677949 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:31.677922    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b92bda_269b_4474_9590_ccaefd26b70d.slice/crio-90dd4abec90c513216b96f64dde330c40c5f72241ef8b2d811c37d752d45248e WatchSource:0}: Error finding container 90dd4abec90c513216b96f64dde330c40c5f72241ef8b2d811c37d752d45248e: Status 404 returned error can't find the container with id 90dd4abec90c513216b96f64dde330c40c5f72241ef8b2d811c37d752d45248e
Sep 09 23:16:31.756634 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.756599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4" event={"ID":"66b92bda-269b-4474-9590-ccaefd26b70d","Type":"ContainerStarted","Data":"90dd4abec90c513216b96f64dde330c40c5f72241ef8b2d811c37d752d45248e"}
Sep 09 23:16:31.758133 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.758090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck" event={"ID":"66401faf-b459-4ca2-80f9-12a87604a534","Type":"ContainerStarted","Data":"ca15f8be17d34055e3ad3f0b40e9c8fd3b415a155755d78f23993bfb2ce08077"}
Sep 09 23:16:31.863707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.863634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.866543 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.866494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c32e1dd-3e14-426b-9eb6-c8158c91a3a6-tls-certs\") pod \"model-serving-api-54d89bd5fc-gg6x5\" (UID: \"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6\") " pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:31.951105 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:31.951082    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cfb041_8a81_4b65_ab13_e8eab8f6ae56.slice/crio-82be4248a5841ba040cbc8a1ebb1991c055d139e35c3c93337e237b99ad6a923 WatchSource:0}: Error finding container 82be4248a5841ba040cbc8a1ebb1991c055d139e35c3c93337e237b99ad6a923: Status 404 returned error can't find the container with id 82be4248a5841ba040cbc8a1ebb1991c055d139e35c3c93337e237b99ad6a923
Sep 09 23:16:31.951961 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:31.951942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:32.082375 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:32.082353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:32.365225 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:32.365197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gg6x5"]
Sep 09 23:16:32.764796 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:32.764703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" event={"ID":"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56","Type":"ContainerStarted","Data":"82be4248a5841ba040cbc8a1ebb1991c055d139e35c3c93337e237b99ad6a923"}
Sep 09 23:16:33.157606 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:33.157534    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c32e1dd_3e14_426b_9eb6_c8158c91a3a6.slice/crio-b3c2486a72ad88272062991069e37293c87b11d608962979a70272693213c3e7 WatchSource:0}: Error finding container b3c2486a72ad88272062991069e37293c87b11d608962979a70272693213c3e7: Status 404 returned error can't find the container with id b3c2486a72ad88272062991069e37293c87b11d608962979a70272693213c3e7
Sep 09 23:16:33.771195 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:33.771099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5" event={"ID":"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6","Type":"ContainerStarted","Data":"b3c2486a72ad88272062991069e37293c87b11d608962979a70272693213c3e7"}
Sep 09 23:16:36.547534 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.547500    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:16:36.547827 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.547572    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:16:36.786120 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.786018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck" event={"ID":"66401faf-b459-4ca2-80f9-12a87604a534","Type":"ContainerStarted","Data":"2c78f577babbc6f0d40bc463d44b9bb913ef877bb689d02003f71eeee5e16f98"}
Sep 09 23:16:36.787586 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.787549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5" event={"ID":"9c32e1dd-3e14-426b-9eb6-c8158c91a3a6","Type":"ContainerStarted","Data":"78e6a484a82d9b6a658393998ab968baa15625e143e91b755ad7e24ff4ec02db"}
Sep 09 23:16:36.787720 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.787621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:16:36.789157 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.789136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" event={"ID":"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56","Type":"ContainerStarted","Data":"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"}
Sep 09 23:16:36.789266 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.789224    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:36.790643 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.790626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4" event={"ID":"66b92bda-269b-4474-9590-ccaefd26b70d","Type":"ContainerStarted","Data":"9a075e09246a27c8379192fed1cc3a71dbe76d30e94b6b635daddb597107bbda"}
Sep 09 23:16:36.790749 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.790738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:36.826741 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.826694    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ddf9d86bc-p28ck" podStartSLOduration=1.251316434 podStartE2EDuration="6.826678655s" totalImagesPullingTime="5.575362221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:36.824127356 +0000 UTC m=+595.431737008" watchObservedRunningTime="2026-09-09 23:16:36.826678655 +0000 UTC m=+595.434288315"
Sep 09 23:16:36.845769 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.845720    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4" podStartSLOduration=1.98484331 podStartE2EDuration="6.845703508s" totalImagesPullingTime="4.860860198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:36.845399942 +0000 UTC m=+595.453009605" watchObservedRunningTime="2026-09-09 23:16:36.845703508 +0000 UTC m=+595.453313168"
Sep 09 23:16:36.863598 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.863550    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5" podStartSLOduration=2.4830312 podStartE2EDuration="5.863532259s" totalImagesPullingTime="3.380501059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:36.863304821 +0000 UTC m=+595.470914481" watchObservedRunningTime="2026-09-09 23:16:36.863532259 +0000 UTC m=+595.471141919"
Sep 09 23:16:36.888317 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:36.888271    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" podStartSLOduration=1.294402366 podStartE2EDuration="5.888256033s" totalImagesPullingTime="4.593853667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:36.887943027 +0000 UTC m=+595.495552689" watchObservedRunningTime="2026-09-09 23:16:36.888256033 +0000 UTC m=+595.495865710"
Sep 09 23:16:37.797371 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:37.797342    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-4cqxz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 23:16:37.797708 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:37.797419    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:16:38.308665 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.308626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"]
Sep 09 23:16:38.311937 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.311912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.314859 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.314838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mz8fr\""
Sep 09 23:16:38.326385 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.326366    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"]
Sep 09 23:16:38.424393 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d8lf\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-kube-api-access-5d8lf\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424608 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424608 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9945df4f-4f97-4edc-aa52-8550a99edb0e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424608 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424608 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.424780 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.424687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d8lf\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-kube-api-access-5d8lf\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525804 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525804 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525804 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525804 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9945df4f-4f97-4edc-aa52-8550a99edb0e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.525804 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525800    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526045 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526045 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526045 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.525895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526225 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.526155    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526225 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.526198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526348 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.526327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526408 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.526354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.526554 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.526533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9945df4f-4f97-4edc-aa52-8550a99edb0e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.528102 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.528083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.528355 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.528326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.541649 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.541626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.543091 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.543071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d8lf\" (UniqueName: \"kubernetes.io/projected/9945df4f-4f97-4edc-aa52-8550a99edb0e-kube-api-access-5d8lf\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5\" (UID: \"9945df4f-4f97-4edc-aa52-8550a99edb0e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.622133 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.622064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:38.900597 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:38.900535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"]
Sep 09 23:16:38.903743 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:38.903717    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9945df4f_4f97_4edc_aa52_8550a99edb0e.slice/crio-96bd738bb352dcd36a723a7baee07b5ccf86cc9418cebe2c25476b6a8f79f614 WatchSource:0}: Error finding container 96bd738bb352dcd36a723a7baee07b5ccf86cc9418cebe2c25476b6a8f79f614: Status 404 returned error can't find the container with id 96bd738bb352dcd36a723a7baee07b5ccf86cc9418cebe2c25476b6a8f79f614
Sep 09 23:16:39.804585 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:39.804554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5" event={"ID":"9945df4f-4f97-4edc-aa52-8550a99edb0e","Type":"ContainerStarted","Data":"96bd738bb352dcd36a723a7baee07b5ccf86cc9418cebe2c25476b6a8f79f614"}
Sep 09 23:16:40.376827 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.376794    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"]
Sep 09 23:16:40.380016 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.379994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.382305 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.382283    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lvl9v\""
Sep 09 23:16:40.382603 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.382581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 23:16:40.385031 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.385011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"]
Sep 09 23:16:40.389082 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.388936    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"]
Sep 09 23:16:40.389082 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.389030    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.391834 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.391062    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wtk2m\""
Sep 09 23:16:40.391834 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.391239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 23:16:40.399716 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.399524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"]
Sep 09 23:16:40.541440 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.541409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm9qb\" (UniqueName: \"kubernetes.io/projected/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-kube-api-access-nm9qb\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.541600 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.541456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7jx\" (UniqueName: \"kubernetes.io/projected/f9a8bfdd-f029-434b-b09a-4a97443991f7-kube-api-access-nb7jx\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.541659 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.541613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.541697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.541656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9a8bfdd-f029-434b-b09a-4a97443991f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.642438 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.642362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.642438 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.642411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9a8bfdd-f029-434b-b09a-4a97443991f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.642646 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.642466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm9qb\" (UniqueName: \"kubernetes.io/projected/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-kube-api-access-nm9qb\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.642646 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.642496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7jx\" (UniqueName: \"kubernetes.io/projected/f9a8bfdd-f029-434b-b09a-4a97443991f7-kube-api-access-nb7jx\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.642646 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:40.642516    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 09 23:16:40.642646 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:40.642589    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert podName:ddc7ddef-8a00-46ef-84c1-5ab468437c0b nodeName:}" failed. No retries permitted until 2026-09-09 23:16:41.142565156 +0000 UTC m=+599.750174798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert") pod "kserve-controller-manager-d6f4b65b8-vkqxq" (UID: "ddc7ddef-8a00-46ef-84c1-5ab468437c0b") : secret "kserve-webhook-server-cert" not found
Sep 09 23:16:40.644999 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.644977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9a8bfdd-f029-434b-b09a-4a97443991f7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.665096 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.665072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm9qb\" (UniqueName: \"kubernetes.io/projected/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-kube-api-access-nm9qb\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:40.665841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.665817    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7jx\" (UniqueName: \"kubernetes.io/projected/f9a8bfdd-f029-434b-b09a-4a97443991f7-kube-api-access-nb7jx\") pod \"llmisvc-controller-manager-777c6bd7d5-nfhw7\" (UID: \"f9a8bfdd-f029-434b-b09a-4a97443991f7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.704306 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.704287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:40.796966 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:40.796946    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:41.146975 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.146946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:41.149254 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.149229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddc7ddef-8a00-46ef-84c1-5ab468437c0b-cert\") pod \"kserve-controller-manager-d6f4b65b8-vkqxq\" (UID: \"ddc7ddef-8a00-46ef-84c1-5ab468437c0b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:41.294223 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.294187    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:41.470847 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.470797    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:16:41.471240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.470896    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:16:41.471240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.470929    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:16:41.673157 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.673134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"]
Sep 09 23:16:41.676201 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:41.675455    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc7ddef_8a00_46ef_84c1_5ab468437c0b.slice/crio-882ede6d46990525c75d66ab1883e1436d134e2a421fff1f2873c3bf6b9fe4a8 WatchSource:0}: Error finding container 882ede6d46990525c75d66ab1883e1436d134e2a421fff1f2873c3bf6b9fe4a8: Status 404 returned error can't find the container with id 882ede6d46990525c75d66ab1883e1436d134e2a421fff1f2873c3bf6b9fe4a8
Sep 09 23:16:41.676567 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.676542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"]
Sep 09 23:16:41.680732 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:16:41.680710    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9a8bfdd_f029_434b_b09a_4a97443991f7.slice/crio-380a18684fcd4c665c706733d92a464485fbc0fa8ea0df19071fbc71ba3e6947 WatchSource:0}: Error finding container 380a18684fcd4c665c706733d92a464485fbc0fa8ea0df19071fbc71ba3e6947: Status 404 returned error can't find the container with id 380a18684fcd4c665c706733d92a464485fbc0fa8ea0df19071fbc71ba3e6947
Sep 09 23:16:41.813462 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.813429    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq" event={"ID":"ddc7ddef-8a00-46ef-84c1-5ab468437c0b","Type":"ContainerStarted","Data":"882ede6d46990525c75d66ab1883e1436d134e2a421fff1f2873c3bf6b9fe4a8"}
Sep 09 23:16:41.814459 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.814432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7" event={"ID":"f9a8bfdd-f029-434b-b09a-4a97443991f7","Type":"ContainerStarted","Data":"380a18684fcd4c665c706733d92a464485fbc0fa8ea0df19071fbc71ba3e6947"}
Sep 09 23:16:41.815730 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.815711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5" event={"ID":"9945df4f-4f97-4edc-aa52-8550a99edb0e","Type":"ContainerStarted","Data":"5612adeee35646f4caf3b99169e675a78c2d55f2853c7fa2c58aa357ce874afd"}
Sep 09 23:16:41.837181 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:41.837133    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5" podStartSLOduration=1.2722309489999999 podStartE2EDuration="3.837104665s" totalImagesPullingTime="2.564873716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:41.835993187 +0000 UTC m=+600.443602858" watchObservedRunningTime="2026-09-09 23:16:41.837104665 +0000 UTC m=+600.444714324"
Sep 09 23:16:42.623144 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:42.623096    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:42.629148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:42.629103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:42.820446 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:42.820410    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:42.821511 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:42.821488    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5"
Sep 09 23:16:44.831484 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.831446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq" event={"ID":"ddc7ddef-8a00-46ef-84c1-5ab468437c0b","Type":"ContainerStarted","Data":"dca3a18df71188f32cada88e9f23b76365e752f8d0f03cfe0a02cae30d20e4e0"}
Sep 09 23:16:44.831831 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.831616    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:16:44.832896 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.832872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7" event={"ID":"f9a8bfdd-f029-434b-b09a-4a97443991f7","Type":"ContainerStarted","Data":"89818524b1b099ec7f45a2eec3ff806a38b5b474e7d1cf297ebdd0a3e7fe86c3"}
Sep 09 23:16:44.833055 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.833040    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:16:44.847197 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.847152    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq" podStartSLOduration=1.873827979 podStartE2EDuration="4.847138108s" totalImagesPullingTime="2.973310129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:44.845194407 +0000 UTC m=+603.452804065" watchObservedRunningTime="2026-09-09 23:16:44.847138108 +0000 UTC m=+603.454747767"
Sep 09 23:16:44.859408 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:44.859356    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7" podStartSLOduration=1.8873167990000002 podStartE2EDuration="4.859341027s" totalImagesPullingTime="2.972024228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:44.85865973 +0000 UTC m=+603.466269409" watchObservedRunningTime="2026-09-09 23:16:44.859341027 +0000 UTC m=+603.466950685"
Sep 09 23:16:45.198989 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.198955    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:45.199168 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.199146    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerName="discovery" containerID="cri-o://0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76" gracePeriod=30
Sep 09 23:16:45.441586 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.441567    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:45.587220 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587351 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587223    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587351 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587351 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587351 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587309    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587554 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77mdq\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587554 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token\") pod \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\" (UID: \"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56\") "
Sep 09 23:16:45.587658 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.587632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:16:45.589495 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589467    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:16:45.589614 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:16:45.589687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589672    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts" (OuterVolumeSpecName: "cacerts") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:16:45.589731 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589696    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs" (OuterVolumeSpecName: "local-certs") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:16:45.589798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589776    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:45.589883 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.589836    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq" (OuterVolumeSpecName: "kube-api-access-77mdq") pod "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" (UID: "c9cfb041-8a81-4b65-ab13-e8eab8f6ae56"). InnerVolumeSpecName "kube-api-access-77mdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:45.688456 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688431    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77mdq\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-kube-api-access-77mdq\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688456 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688453    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-token\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688465    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-local-certs\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688476    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-cacerts\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688490    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-ca-configmap\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688501    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-csr-dns-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.688590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.688513    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56-istio-kubeconfig\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.838156 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.838089    2578 generic.go:356] "Generic (PLEG): container finished" podID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerID="0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76" exitCode=0
Sep 09 23:16:45.838437 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.838154    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"
Sep 09 23:16:45.838437 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.838173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" event={"ID":"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56","Type":"ContainerDied","Data":"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"}
Sep 09 23:16:45.838437 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.838220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz" event={"ID":"c9cfb041-8a81-4b65-ab13-e8eab8f6ae56","Type":"ContainerDied","Data":"82be4248a5841ba040cbc8a1ebb1991c055d139e35c3c93337e237b99ad6a923"}
Sep 09 23:16:45.838437 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.838242    2578 scope.go:117] "RemoveContainer" containerID="0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"
Sep 09 23:16:45.846832 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.846815    2578 scope.go:117] "RemoveContainer" containerID="0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"
Sep 09 23:16:45.847075 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:16:45.847057    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76\": container with ID starting with 0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76 not found: ID does not exist" containerID="0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"
Sep 09 23:16:45.847149 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.847081    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76"} err="failed to get container status \"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76\": rpc error: code = NotFound desc = could not find container \"0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76\": container with ID starting with 0dde3095ae1abc85bac06b3da23958ee4973bdde14c32d32e30eaa10227c9f76 not found: ID does not exist"
Sep 09 23:16:45.858247 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.858227    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:45.861893 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.861871    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4cqxz"]
Sep 09 23:16:45.950841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:45.950820    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" path="/var/lib/kubelet/pods/c9cfb041-8a81-4b65-ab13-e8eab8f6ae56/volumes"
Sep 09 23:16:47.797145 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:47.797094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sdfp4"
Sep 09 23:16:47.799089 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:16:47.799069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gg6x5"
Sep 09 23:17:15.840746 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:15.840681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nfhw7"
Sep 09 23:17:15.842795 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:15.842771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vkqxq"
Sep 09 23:17:46.339387 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.339357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"]
Sep 09 23:17:46.339738 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.339622    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerName="discovery"
Sep 09 23:17:46.339738 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.339632    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerName="discovery"
Sep 09 23:17:46.339738 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.339679    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cfb041-8a81-4b65-ab13-e8eab8f6ae56" containerName="discovery"
Sep 09 23:17:46.342218 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.342201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:46.344691 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.344660    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qhsfj\""
Sep 09 23:17:46.345498 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.345481    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 23:17:46.345599 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.345507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 23:17:46.352015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.351996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"]
Sep 09 23:17:46.390049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.390026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtm4\" (UniqueName: \"kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4\") pod \"limitador-operator-controller-manager-74495c69f8-fhvv7\" (UID: \"63015be5-a83b-4c2a-a51e-b16ead694dff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:46.490930 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.490903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtm4\" (UniqueName: \"kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4\") pod \"limitador-operator-controller-manager-74495c69f8-fhvv7\" (UID: \"63015be5-a83b-4c2a-a51e-b16ead694dff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:46.499779 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.499755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtm4\" (UniqueName: \"kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4\") pod \"limitador-operator-controller-manager-74495c69f8-fhvv7\" (UID: \"63015be5-a83b-4c2a-a51e-b16ead694dff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:46.651866 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.651809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:46.931946 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.931801    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"]
Sep 09 23:17:46.934323 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:17:46.934294    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63015be5_a83b_4c2a_a51e_b16ead694dff.slice/crio-c2c492cb4dc9710014229f55fbdc817a1798bf45f06ad0c6a4a50842915fcf94 WatchSource:0}: Error finding container c2c492cb4dc9710014229f55fbdc817a1798bf45f06ad0c6a4a50842915fcf94: Status 404 returned error can't find the container with id c2c492cb4dc9710014229f55fbdc817a1798bf45f06ad0c6a4a50842915fcf94
Sep 09 23:17:46.936528 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:46.936508    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:17:47.066293 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:47.066256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7" event={"ID":"63015be5-a83b-4c2a-a51e-b16ead694dff","Type":"ContainerStarted","Data":"c2c492cb4dc9710014229f55fbdc817a1798bf45f06ad0c6a4a50842915fcf94"}
Sep 09 23:17:48.779875 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:48.779841    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-dkz9z"]
Sep 09 23:17:48.785382 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:48.785361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:48.787826 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:48.787795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-d8kbt\""
Sep 09 23:17:48.797903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:48.796309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-dkz9z"]
Sep 09 23:17:48.908618 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:48.908586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tt8f\" (UniqueName: \"kubernetes.io/projected/f35ace3a-328c-4127-aac1-77fa1aa03edd-kube-api-access-8tt8f\") pod \"authorino-operator-76b478bd78-dkz9z\" (UID: \"f35ace3a-328c-4127-aac1-77fa1aa03edd\") " pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:49.009336 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:49.009303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tt8f\" (UniqueName: \"kubernetes.io/projected/f35ace3a-328c-4127-aac1-77fa1aa03edd-kube-api-access-8tt8f\") pod \"authorino-operator-76b478bd78-dkz9z\" (UID: \"f35ace3a-328c-4127-aac1-77fa1aa03edd\") " pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:49.017753 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:49.017710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tt8f\" (UniqueName: \"kubernetes.io/projected/f35ace3a-328c-4127-aac1-77fa1aa03edd-kube-api-access-8tt8f\") pod \"authorino-operator-76b478bd78-dkz9z\" (UID: \"f35ace3a-328c-4127-aac1-77fa1aa03edd\") " pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:49.097403 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:49.097344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:49.659913 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:49.659890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-dkz9z"]
Sep 09 23:17:49.662789 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:17:49.662765    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35ace3a_328c_4127_aac1_77fa1aa03edd.slice/crio-9297ea579f8928509d19cdb0cf28b3f08d5da2e70c63417512ff8c17e29ee9a7 WatchSource:0}: Error finding container 9297ea579f8928509d19cdb0cf28b3f08d5da2e70c63417512ff8c17e29ee9a7: Status 404 returned error can't find the container with id 9297ea579f8928509d19cdb0cf28b3f08d5da2e70c63417512ff8c17e29ee9a7
Sep 09 23:17:50.082809 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:50.082776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7" event={"ID":"63015be5-a83b-4c2a-a51e-b16ead694dff","Type":"ContainerStarted","Data":"05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c"}
Sep 09 23:17:50.083271 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:50.082834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:17:50.083972 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:50.083949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z" event={"ID":"f35ace3a-328c-4127-aac1-77fa1aa03edd","Type":"ContainerStarted","Data":"9297ea579f8928509d19cdb0cf28b3f08d5da2e70c63417512ff8c17e29ee9a7"}
Sep 09 23:17:50.105469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:50.105424    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7" podStartSLOduration=1.612365601 podStartE2EDuration="4.105409743s" totalImagesPullingTime="2.493044142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:50.104441941 +0000 UTC m=+668.712051599" watchObservedRunningTime="2026-09-09 23:17:50.105409743 +0000 UTC m=+668.713019401"
Sep 09 23:17:51.089800 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:51.089767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z" event={"ID":"f35ace3a-328c-4127-aac1-77fa1aa03edd","Type":"ContainerStarted","Data":"b8bda8dba1e68ef981a3819870aef84c16125a49a31488cd5a8691bb294568cc"}
Sep 09 23:17:51.090081 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:51.089999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:17:51.107770 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:51.107728    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z" podStartSLOduration=1.800481727 podStartE2EDuration="3.107715631s" totalImagesPullingTime="1.307233904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:51.106749894 +0000 UTC m=+669.714359554" watchObservedRunningTime="2026-09-09 23:17:51.107715631 +0000 UTC m=+669.715325290"
Sep 09 23:17:53.180478 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.180446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"]
Sep 09 23:17:53.182688 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.182666    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.184843 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.184819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5mct6\""
Sep 09 23:17:53.194341 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.194319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"]
Sep 09 23:17:53.239462 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.239433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqfk\" (UniqueName: \"kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.239575 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.239488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.340128 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.340082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqfk\" (UniqueName: \"kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.340219 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.340144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.340453 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.340437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.351696 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.351673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqfk\" (UniqueName: \"kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.492938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.492920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:53.768365 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:53.768330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"]
Sep 09 23:17:53.770857 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:17:53.770832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503a9189_f6e3_4eb2_80ad_0f9ffac5137f.slice/crio-c625384a33e7aae5a147fd53892e53a3bdb18d7172c943399e34d5c21a4ed005 WatchSource:0}: Error finding container c625384a33e7aae5a147fd53892e53a3bdb18d7172c943399e34d5c21a4ed005: Status 404 returned error can't find the container with id c625384a33e7aae5a147fd53892e53a3bdb18d7172c943399e34d5c21a4ed005
Sep 09 23:17:54.103291 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:54.103220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4" event={"ID":"503a9189-f6e3-4eb2-80ad-0f9ffac5137f","Type":"ContainerStarted","Data":"c625384a33e7aae5a147fd53892e53a3bdb18d7172c943399e34d5c21a4ed005"}
Sep 09 23:17:58.124439 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:58.124398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4" event={"ID":"503a9189-f6e3-4eb2-80ad-0f9ffac5137f","Type":"ContainerStarted","Data":"489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8"}
Sep 09 23:17:58.124878 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:58.124534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:17:58.144478 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:17:58.144423    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4" podStartSLOduration=1.231339298 podStartE2EDuration="5.144405801s" totalImagesPullingTime="3.913066503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:58.143209025 +0000 UTC m=+676.750818685" watchObservedRunningTime="2026-09-09 23:17:58.144405801 +0000 UTC m=+676.752015474"
Sep 09 23:18:01.092241 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:01.092212    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:02.096076 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:02.096047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-dkz9z"
Sep 09 23:18:09.130106 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:09.130078    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.225026 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.224994    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"]
Sep 09 23:18:11.225455 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.225183    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" containerName="manager" containerID="cri-o://489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8" gracePeriod=2
Sep 09 23:18:11.240367 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.240335    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"]
Sep 09 23:18:11.248795 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.248771    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"]
Sep 09 23:18:11.248956 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.248930    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" containerName="manager" containerID="cri-o://05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c" gracePeriod=2
Sep 09 23:18:11.253015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.252992    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:11.253296 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.253284    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" containerName="manager"
Sep 09 23:18:11.253347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.253326    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" containerName="manager"
Sep 09 23:18:11.253387 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.253378    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" containerName="manager"
Sep 09 23:18:11.255614 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.255589    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.257187 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.257139    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"]
Sep 09 23:18:11.258905 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.258873    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"63015be5-a83b-4c2a-a51e-b16ead694dff\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-fhvv7\": pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.261130 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.261094    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.263181 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.263157    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.264957 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.264936    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.270644 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.270621    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:11.273434 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.273414    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"]
Sep 09 23:18:11.273681 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.273670    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" containerName="manager"
Sep 09 23:18:11.273721 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.273683    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" containerName="manager"
Sep 09 23:18:11.273753 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.273736    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" containerName="manager"
Sep 09 23:18:11.275410 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.275392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:11.287492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.287458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"]
Sep 09 23:18:11.288305 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.288274    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.290278 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.290252    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.370681 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.370655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.370775 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.370695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwm25\" (UniqueName: \"kubernetes.io/projected/9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c-kube-api-access-nwm25\") pod \"limitador-operator-controller-manager-74495c69f8-rmgpt\" (UID: \"9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:11.370775 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.370721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7pt\" (UniqueName: \"kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.471556 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.471526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwm25\" (UniqueName: \"kubernetes.io/projected/9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c-kube-api-access-nwm25\") pod \"limitador-operator-controller-manager-74495c69f8-rmgpt\" (UID: \"9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:11.471655 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.471565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7pt\" (UniqueName: \"kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.471655 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.471636    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.471999 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.471978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.478104 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.478085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.480179 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.480088    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.481447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.481431    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.481885 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.481865    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.482609 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.482589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwm25\" (UniqueName: \"kubernetes.io/projected/9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c-kube-api-access-nwm25\") pod \"limitador-operator-controller-manager-74495c69f8-rmgpt\" (UID: \"9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:11.483003 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.482983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7pt\" (UniqueName: \"kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt\") pod \"kuadrant-operator-controller-manager-76f8f686bf-4jrpw\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.483440 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.483421    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.484972 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.484951    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.571867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.571844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mqfk\" (UniqueName: \"kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk\") pod \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") "
Sep 09 23:18:11.571953 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.571892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume\") pod \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\" (UID: \"503a9189-f6e3-4eb2-80ad-0f9ffac5137f\") "
Sep 09 23:18:11.571953 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.571928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmtm4\" (UniqueName: \"kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4\") pod \"63015be5-a83b-4c2a-a51e-b16ead694dff\" (UID: \"63015be5-a83b-4c2a-a51e-b16ead694dff\") "
Sep 09 23:18:11.572317 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.572296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "503a9189-f6e3-4eb2-80ad-0f9ffac5137f" (UID: "503a9189-f6e3-4eb2-80ad-0f9ffac5137f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:18:11.573737 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.573721    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4" (OuterVolumeSpecName: "kube-api-access-gmtm4") pod "63015be5-a83b-4c2a-a51e-b16ead694dff" (UID: "63015be5-a83b-4c2a-a51e-b16ead694dff"). InnerVolumeSpecName "kube-api-access-gmtm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:18:11.573795 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.573778    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk" (OuterVolumeSpecName: "kube-api-access-4mqfk") pod "503a9189-f6e3-4eb2-80ad-0f9ffac5137f" (UID: "503a9189-f6e3-4eb2-80ad-0f9ffac5137f"). InnerVolumeSpecName "kube-api-access-4mqfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:18:11.666625 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.666597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:11.672511 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.672493    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmtm4\" (UniqueName: \"kubernetes.io/projected/63015be5-a83b-4c2a-a51e-b16ead694dff-kube-api-access-gmtm4\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:18:11.672565 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.672513    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mqfk\" (UniqueName: \"kubernetes.io/projected/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-kube-api-access-4mqfk\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:18:11.672565 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.672521    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/503a9189-f6e3-4eb2-80ad-0f9ffac5137f-extensions-socket-volume\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:18:11.673436 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.673419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:11.938949 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.938926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:11.941043 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:11.941018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7022729c_9751_4396_a402_083445e4d906.slice/crio-f033b92eb7e129e26fc91e0679aee23f740c3233c7eddd47a74fb3c3f1630762 WatchSource:0}: Error finding container f033b92eb7e129e26fc91e0679aee23f740c3233c7eddd47a74fb3c3f1630762: Status 404 returned error can't find the container with id f033b92eb7e129e26fc91e0679aee23f740c3233c7eddd47a74fb3c3f1630762
Sep 09 23:18:11.943677 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.943656    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"]
Sep 09 23:18:11.947498 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:11.947472    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd64e0d_b4bb_4cf6_b441_b8487f5d5a0c.slice/crio-157dcb739e3ebe00e6b017812d24be940784b63e3e9ea5954bf3cae8a0d76e7b WatchSource:0}: Error finding container 157dcb739e3ebe00e6b017812d24be940784b63e3e9ea5954bf3cae8a0d76e7b: Status 404 returned error can't find the container with id 157dcb739e3ebe00e6b017812d24be940784b63e3e9ea5954bf3cae8a0d76e7b
Sep 09 23:18:11.948752 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.948726    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-fhvv7\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:11.950452 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:11.950358    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-prfj4\" is forbidden: User \"system:node:ip-10-0-138-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-84.ec2.internal' and this object" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:11.951821 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.951799    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" path="/var/lib/kubelet/pods/503a9189-f6e3-4eb2-80ad-0f9ffac5137f/volumes"
Sep 09 23:18:11.952090 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:11.952078    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63015be5-a83b-4c2a-a51e-b16ead694dff" path="/var/lib/kubelet/pods/63015be5-a83b-4c2a-a51e-b16ead694dff/volumes"
Sep 09 23:18:12.182772 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.182733    2578 generic.go:356] "Generic (PLEG): container finished" podID="63015be5-a83b-4c2a-a51e-b16ead694dff" containerID="05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c" exitCode=0
Sep 09 23:18:12.182927 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.182778    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-fhvv7"
Sep 09 23:18:12.182927 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.182835    2578 scope.go:117] "RemoveContainer" containerID="05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c"
Sep 09 23:18:12.184295 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.184266    2578 generic.go:356] "Generic (PLEG): container finished" podID="503a9189-f6e3-4eb2-80ad-0f9ffac5137f" containerID="489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8" exitCode=0
Sep 09 23:18:12.184423 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.184308    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-prfj4"
Sep 09 23:18:12.186472 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.186448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" event={"ID":"7022729c-9751-4396-a402-083445e4d906","Type":"ContainerStarted","Data":"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"}
Sep 09 23:18:12.186600 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.186505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" event={"ID":"7022729c-9751-4396-a402-083445e4d906","Type":"ContainerStarted","Data":"f033b92eb7e129e26fc91e0679aee23f740c3233c7eddd47a74fb3c3f1630762"}
Sep 09 23:18:12.186665 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.186651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:12.188593 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.188572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt" event={"ID":"9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c","Type":"ContainerStarted","Data":"f8a14504312842ccb7c11414d28513394b559d3d06655ea314d10fb772ef4a78"}
Sep 09 23:18:12.188702 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.188607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt" event={"ID":"9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c","Type":"ContainerStarted","Data":"157dcb739e3ebe00e6b017812d24be940784b63e3e9ea5954bf3cae8a0d76e7b"}
Sep 09 23:18:12.188702 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.188632    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:12.191418 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.191401    2578 scope.go:117] "RemoveContainer" containerID="05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c"
Sep 09 23:18:12.191675 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:12.191658    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c\": container with ID starting with 05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c not found: ID does not exist" containerID="05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c"
Sep 09 23:18:12.191718 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.191684    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c"} err="failed to get container status \"05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c\": rpc error: code = NotFound desc = could not find container \"05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c\": container with ID starting with 05a3b05f0756e79a7362126c069d09577e326c9c0642c4d46e78b3653367af4c not found: ID does not exist"
Sep 09 23:18:12.191718 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.191700    2578 scope.go:117] "RemoveContainer" containerID="489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8"
Sep 09 23:18:12.198701 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.198683    2578 scope.go:117] "RemoveContainer" containerID="489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8"
Sep 09 23:18:12.198930 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:12.198913    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8\": container with ID starting with 489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8 not found: ID does not exist" containerID="489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8"
Sep 09 23:18:12.198981 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.198936    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8"} err="failed to get container status \"489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8\": rpc error: code = NotFound desc = could not find container \"489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8\": container with ID starting with 489a62520f82a6492272ffe3e6e524171eac55327876b1b6386b07ede4e3f0f8 not found: ID does not exist"
Sep 09 23:18:12.214480 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.214441    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" podStartSLOduration=1.214429672 podStartE2EDuration="1.214429672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:12.212653701 +0000 UTC m=+690.820263370" watchObservedRunningTime="2026-09-09 23:18:12.214429672 +0000 UTC m=+690.822039330"
Sep 09 23:18:12.233227 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:12.233190    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt" podStartSLOduration=1.233179997 podStartE2EDuration="1.233179997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:12.232624633 +0000 UTC m=+690.840234293" watchObservedRunningTime="2026-09-09 23:18:12.233179997 +0000 UTC m=+690.840789656"
Sep 09 23:18:23.196314 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:23.196285    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rmgpt"
Sep 09 23:18:23.196733 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:23.196429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:26.675427 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.675393    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:26.675768 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.675580    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" podUID="7022729c-9751-4396-a402-083445e4d906" containerName="manager" containerID="cri-o://6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7" gracePeriod=10
Sep 09 23:18:26.898627 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.898466    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"]
Sep 09 23:18:26.900665 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.900641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:26.914903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.914876    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"]
Sep 09 23:18:26.915560 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.915541    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:26.983324 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.983305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb7pt\" (UniqueName: \"kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt\") pod \"7022729c-9751-4396-a402-083445e4d906\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") "
Sep 09 23:18:26.983451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.983354    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume\") pod \"7022729c-9751-4396-a402-083445e4d906\" (UID: \"7022729c-9751-4396-a402-083445e4d906\") "
Sep 09 23:18:26.983498 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.983480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg576\" (UniqueName: \"kubernetes.io/projected/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-kube-api-access-dg576\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:26.983570 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.983553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:26.983755 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.983731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7022729c-9751-4396-a402-083445e4d906" (UID: "7022729c-9751-4396-a402-083445e4d906"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:18:26.985162 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:26.985140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt" (OuterVolumeSpecName: "kube-api-access-nb7pt") pod "7022729c-9751-4396-a402-083445e4d906" (UID: "7022729c-9751-4396-a402-083445e4d906"). InnerVolumeSpecName "kube-api-access-nb7pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:18:27.084885 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.084861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg576\" (UniqueName: \"kubernetes.io/projected/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-kube-api-access-dg576\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:27.084977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.084906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:27.084977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.084940    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb7pt\" (UniqueName: \"kubernetes.io/projected/7022729c-9751-4396-a402-083445e4d906-kube-api-access-nb7pt\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:18:27.084977 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.084950    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7022729c-9751-4396-a402-083445e4d906-extensions-socket-volume\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:18:27.085229 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.085215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:27.092545 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.092526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg576\" (UniqueName: \"kubernetes.io/projected/5e60e870-1052-4c2e-aaf3-7b713c0be1d4-kube-api-access-dg576\") pod \"kuadrant-operator-controller-manager-5769f99d9f-n5g62\" (UID: \"5e60e870-1052-4c2e-aaf3-7b713c0be1d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:27.222757 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.222737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:27.253342 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.253282    2578 generic.go:356] "Generic (PLEG): container finished" podID="7022729c-9751-4396-a402-083445e4d906" containerID="6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7" exitCode=0
Sep 09 23:18:27.253434 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.253344    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"
Sep 09 23:18:27.253434 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.253367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" event={"ID":"7022729c-9751-4396-a402-083445e4d906","Type":"ContainerDied","Data":"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"}
Sep 09 23:18:27.253434 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.253421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw" event={"ID":"7022729c-9751-4396-a402-083445e4d906","Type":"ContainerDied","Data":"f033b92eb7e129e26fc91e0679aee23f740c3233c7eddd47a74fb3c3f1630762"}
Sep 09 23:18:27.253531 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.253443    2578 scope.go:117] "RemoveContainer" containerID="6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"
Sep 09 23:18:27.261338 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.261321    2578 scope.go:117] "RemoveContainer" containerID="6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"
Sep 09 23:18:27.261750 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:18:27.261723    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7\": container with ID starting with 6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7 not found: ID does not exist" containerID="6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"
Sep 09 23:18:27.261843 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.261757    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7"} err="failed to get container status \"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7\": rpc error: code = NotFound desc = could not find container \"6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7\": container with ID starting with 6e532ca69badcb4a79b3a88e119333252f66ece9bd874d443414f1f09d93cac7 not found: ID does not exist"
Sep 09 23:18:27.279047 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.278990    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:27.283906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.283850    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-4jrpw"]
Sep 09 23:18:27.495714 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.495694    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"]
Sep 09 23:18:27.497906 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:27.497881    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e60e870_1052_4c2e_aaf3_7b713c0be1d4.slice/crio-cd8c545c102154c5c43b579f4ff16525799fc895e51d8d5c7258f9b725b2f854 WatchSource:0}: Error finding container cd8c545c102154c5c43b579f4ff16525799fc895e51d8d5c7258f9b725b2f854: Status 404 returned error can't find the container with id cd8c545c102154c5c43b579f4ff16525799fc895e51d8d5c7258f9b725b2f854
Sep 09 23:18:27.951415 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:27.951331    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7022729c-9751-4396-a402-083445e4d906" path="/var/lib/kubelet/pods/7022729c-9751-4396-a402-083445e4d906/volumes"
Sep 09 23:18:28.259610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:28.259577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62" event={"ID":"5e60e870-1052-4c2e-aaf3-7b713c0be1d4","Type":"ContainerStarted","Data":"8cc4fbfc46047e6fcf8119fec1e43c4d001363aec69b42870ed8ce121abdd146"}
Sep 09 23:18:28.259766 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:28.259631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62" event={"ID":"5e60e870-1052-4c2e-aaf3-7b713c0be1d4","Type":"ContainerStarted","Data":"cd8c545c102154c5c43b579f4ff16525799fc895e51d8d5c7258f9b725b2f854"}
Sep 09 23:18:28.259766 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:28.259705    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:28.280999 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:28.280962    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62" podStartSLOduration=2.280949314 podStartE2EDuration="2.280949314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:28.279465165 +0000 UTC m=+706.887074821" watchObservedRunningTime="2026-09-09 23:18:28.280949314 +0000 UTC m=+706.888558973"
Sep 09 23:18:39.268131 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:39.268038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-n5g62"
Sep 09 23:18:42.962632 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.962599    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"]
Sep 09 23:18:42.963059 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.962876    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7022729c-9751-4396-a402-083445e4d906" containerName="manager"
Sep 09 23:18:42.963059 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.962896    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7022729c-9751-4396-a402-083445e4d906" containerName="manager"
Sep 09 23:18:42.963059 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.962959    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7022729c-9751-4396-a402-083445e4d906" containerName="manager"
Sep 09 23:18:42.965911 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.965890    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:42.967889 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.967869    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dgxkz\""
Sep 09 23:18:42.976347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:42.976319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"]
Sep 09 23:18:43.090588 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnh4l\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-kube-api-access-pnh4l\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090602    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.090906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.090857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191275 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191379 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191379 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191379 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnh4l\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-kube-api-access-pnh4l\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191533 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191533 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191533 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191697 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191841 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.191971 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.191948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.192275 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.192254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.193590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.193572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.193968 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.193950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.198895 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.198872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.199347 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.199327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnh4l\" (UniqueName: \"kubernetes.io/projected/ef75dee5-8225-4c45-b8b5-90c9c462c56e-kube-api-access-pnh4l\") pod \"maas-default-gateway-openshift-default-5ccb968c66-nlfrg\" (UID: \"ef75dee5-8225-4c45-b8b5-90c9c462c56e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.275846 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.275793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:43.549541 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.549517    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"]
Sep 09 23:18:43.551956 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:43.551928    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef75dee5_8225_4c45_b8b5_90c9c462c56e.slice/crio-e03854fea45d0fa1ab6764c9f7f767f9d232b528b21b93a60218340bee1dec83 WatchSource:0}: Error finding container e03854fea45d0fa1ab6764c9f7f767f9d232b528b21b93a60218340bee1dec83: Status 404 returned error can't find the container with id e03854fea45d0fa1ab6764c9f7f767f9d232b528b21b93a60218340bee1dec83
Sep 09 23:18:43.554642 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.554594    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:18:43.554743 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.554672    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:18:43.554743 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:43.554711    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:18:44.326917 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:44.326884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" event={"ID":"ef75dee5-8225-4c45-b8b5-90c9c462c56e","Type":"ContainerStarted","Data":"6c95f3725b0c9d5c8625d8f9023a06ffa71c5c3570dcdfa821d14f8c3b86e089"}
Sep 09 23:18:44.327337 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:44.326942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" event={"ID":"ef75dee5-8225-4c45-b8b5-90c9c462c56e","Type":"ContainerStarted","Data":"e03854fea45d0fa1ab6764c9f7f767f9d232b528b21b93a60218340bee1dec83"}
Sep 09 23:18:44.346033 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:44.345988    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podStartSLOduration=2.345972935 podStartE2EDuration="2.345972935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:44.344174068 +0000 UTC m=+722.951783726" watchObservedRunningTime="2026-09-09 23:18:44.345972935 +0000 UTC m=+722.953582593"
Sep 09 23:18:45.276795 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:45.276764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:45.281073 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:45.281043    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:45.331441 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:45.331416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:45.332033 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:45.332019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:18:59.187340 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.187299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:18:59.189707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.189683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:18:59.191865 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.191847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bj5nh\""
Sep 09 23:18:59.197078 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.197058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:18:59.308428 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.308404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlt6h\" (UniqueName: \"kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h\") pod \"authorino-7bcfd8f9cd-fbbzb\" (UID: \"ee1c5d91-5011-45dc-a601-1f624e6d9e90\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:18:59.323501 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.323476    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:18:59.325597 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.325580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:18:59.335496 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.335473    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:18:59.409033 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.409006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlt6h\" (UniqueName: \"kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h\") pod \"authorino-7bcfd8f9cd-fbbzb\" (UID: \"ee1c5d91-5011-45dc-a601-1f624e6d9e90\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:18:59.415787 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.415765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlt6h\" (UniqueName: \"kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h\") pod \"authorino-7bcfd8f9cd-fbbzb\" (UID: \"ee1c5d91-5011-45dc-a601-1f624e6d9e90\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:18:59.499205 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.499183    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:18:59.510258 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.510232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxxd4\" (UniqueName: \"kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4\") pod \"authorino-59c974bd48-9qlm6\" (UID: \"b7e588fd-81cc-40be-bea5-7a7d9b4f0152\") " pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:18:59.611362 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.611330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxxd4\" (UniqueName: \"kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4\") pod \"authorino-59c974bd48-9qlm6\" (UID: \"b7e588fd-81cc-40be-bea5-7a7d9b4f0152\") " pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:18:59.621148 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.621123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxxd4\" (UniqueName: \"kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4\") pod \"authorino-59c974bd48-9qlm6\" (UID: \"b7e588fd-81cc-40be-bea5-7a7d9b4f0152\") " pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:18:59.634037 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.634020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:18:59.762162 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.762139    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:18:59.764291 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:59.764271    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee1c5d91_5011_45dc_a601_1f624e6d9e90.slice/crio-410e91406ae5e8a445f87cbdff8df7db5979818b5a9b7d2939d608684b3219b1 WatchSource:0}: Error finding container 410e91406ae5e8a445f87cbdff8df7db5979818b5a9b7d2939d608684b3219b1: Status 404 returned error can't find the container with id 410e91406ae5e8a445f87cbdff8df7db5979818b5a9b7d2939d608684b3219b1
Sep 09 23:18:59.894590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:18:59.894567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:18:59.897165 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:18:59.897146    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7e588fd_81cc_40be_bea5_7a7d9b4f0152.slice/crio-4229a680ffa6c1b92df48aa3a0d6f26fe9edb748d556a34e318217309aa4c01d WatchSource:0}: Error finding container 4229a680ffa6c1b92df48aa3a0d6f26fe9edb748d556a34e318217309aa4c01d: Status 404 returned error can't find the container with id 4229a680ffa6c1b92df48aa3a0d6f26fe9edb748d556a34e318217309aa4c01d
Sep 09 23:19:00.391160 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:00.391130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" event={"ID":"ee1c5d91-5011-45dc-a601-1f624e6d9e90","Type":"ContainerStarted","Data":"410e91406ae5e8a445f87cbdff8df7db5979818b5a9b7d2939d608684b3219b1"}
Sep 09 23:19:00.392200 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:00.392171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9qlm6" event={"ID":"b7e588fd-81cc-40be-bea5-7a7d9b4f0152","Type":"ContainerStarted","Data":"4229a680ffa6c1b92df48aa3a0d6f26fe9edb748d556a34e318217309aa4c01d"}
Sep 09 23:19:02.401250 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:02.401218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9qlm6" event={"ID":"b7e588fd-81cc-40be-bea5-7a7d9b4f0152","Type":"ContainerStarted","Data":"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"}
Sep 09 23:19:02.402545 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:02.402518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" event={"ID":"ee1c5d91-5011-45dc-a601-1f624e6d9e90","Type":"ContainerStarted","Data":"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"}
Sep 09 23:19:02.415361 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:02.415313    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-9qlm6" podStartSLOduration=1.913305028 podStartE2EDuration="3.415297103s" totalImagesPullingTime="1.501992075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:02.41374207 +0000 UTC m=+741.021351729" watchObservedRunningTime="2026-09-09 23:19:02.415297103 +0000 UTC m=+741.022906767"
Sep 09 23:19:02.428149 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:02.428081    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" podStartSLOduration=1.797489224 podStartE2EDuration="3.428066559s" totalImagesPullingTime="1.630577335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:02.426147638 +0000 UTC m=+741.033757301" watchObservedRunningTime="2026-09-09 23:19:02.428066559 +0000 UTC m=+741.035676216"
Sep 09 23:19:02.449996 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:02.449966    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:19:04.409949 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:04.409889    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" podUID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" containerName="authorino" containerID="cri-o://237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5" gracePeriod=30
Sep 09 23:19:04.639587 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:04.639566    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:19:04.751795 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:04.751774    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlt6h\" (UniqueName: \"kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h\") pod \"ee1c5d91-5011-45dc-a601-1f624e6d9e90\" (UID: \"ee1c5d91-5011-45dc-a601-1f624e6d9e90\") "
Sep 09 23:19:04.753616 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:04.753588    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h" (OuterVolumeSpecName: "kube-api-access-nlt6h") pod "ee1c5d91-5011-45dc-a601-1f624e6d9e90" (UID: "ee1c5d91-5011-45dc-a601-1f624e6d9e90"). InnerVolumeSpecName "kube-api-access-nlt6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:19:04.853268 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:04.853245    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlt6h\" (UniqueName: \"kubernetes.io/projected/ee1c5d91-5011-45dc-a601-1f624e6d9e90-kube-api-access-nlt6h\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:19:05.415293 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.415267    2578 generic.go:356] "Generic (PLEG): container finished" podID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" containerID="237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5" exitCode=0
Sep 09 23:19:05.415649 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.415302    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb"
Sep 09 23:19:05.415649 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.415325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" event={"ID":"ee1c5d91-5011-45dc-a601-1f624e6d9e90","Type":"ContainerDied","Data":"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"}
Sep 09 23:19:05.415649 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.415354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fbbzb" event={"ID":"ee1c5d91-5011-45dc-a601-1f624e6d9e90","Type":"ContainerDied","Data":"410e91406ae5e8a445f87cbdff8df7db5979818b5a9b7d2939d608684b3219b1"}
Sep 09 23:19:05.415649 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.415371    2578 scope.go:117] "RemoveContainer" containerID="237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"
Sep 09 23:19:05.423850 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.423834    2578 scope.go:117] "RemoveContainer" containerID="237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"
Sep 09 23:19:05.424184 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:19:05.424087    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5\": container with ID starting with 237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5 not found: ID does not exist" containerID="237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"
Sep 09 23:19:05.424184 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.424135    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5"} err="failed to get container status \"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5\": rpc error: code = NotFound desc = could not find container \"237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5\": container with ID starting with 237d11fdfe85b9688b611e6ca70eeed8be3667457cd8902149d9374ac30296a5 not found: ID does not exist"
Sep 09 23:19:05.434166 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.434145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:19:05.440545 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.440527    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fbbzb"]
Sep 09 23:19:05.951245 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:05.951219    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" path="/var/lib/kubelet/pods/ee1c5d91-5011-45dc-a601-1f624e6d9e90/volumes"
Sep 09 23:19:29.490071 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.490038    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-hjpth"]
Sep 09 23:19:29.490639 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.490492    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" containerName="authorino"
Sep 09 23:19:29.490639 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.490510    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" containerName="authorino"
Sep 09 23:19:29.490639 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.490611    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee1c5d91-5011-45dc-a601-1f624e6d9e90" containerName="authorino"
Sep 09 23:19:29.493591 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.493569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:29.499126 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.499094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-hjpth"]
Sep 09 23:19:29.522062 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.522041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqx9\" (UniqueName: \"kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9\") pod \"authorino-557f876f69-hjpth\" (UID: \"d7e3080c-50d7-4810-a5ae-414751812ea7\") " pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:29.533785 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.533759    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-hjpth"]
Sep 09 23:19:29.533960 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:19:29.533941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ndqx9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-hjpth" podUID="d7e3080c-50d7-4810-a5ae-414751812ea7"
Sep 09 23:19:29.560474 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.560449    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-nbjqg"]
Sep 09 23:19:29.563379 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.563361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.565441 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.565420    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 23:19:29.570189 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.570169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-nbjqg"]
Sep 09 23:19:29.622836 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.622809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnrsb\" (UniqueName: \"kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.622940 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.622863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.622940 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.622923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqx9\" (UniqueName: \"kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9\") pod \"authorino-557f876f69-hjpth\" (UID: \"d7e3080c-50d7-4810-a5ae-414751812ea7\") " pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:29.629791 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.629770    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqx9\" (UniqueName: \"kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9\") pod \"authorino-557f876f69-hjpth\" (UID: \"d7e3080c-50d7-4810-a5ae-414751812ea7\") " pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:29.723341 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.723317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.723441 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.723390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnrsb\" (UniqueName: \"kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.725072 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.725049    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-nbjqg"]
Sep 09 23:19:29.725243 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:19:29.725225    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lnrsb tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-nbjqg" podUID="e51faf4a-d354-414d-b59e-ca987cacd3d3"
Sep 09 23:19:29.725642 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.725623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.737857 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.737838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnrsb\" (UniqueName: \"kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb\") pod \"authorino-6d4dfc649f-nbjqg\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") " pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:29.749339 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.749290    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d65f5d5b8-g2mtx"]
Sep 09 23:19:29.752441 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.752423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.758890 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.758857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d65f5d5b8-g2mtx"]
Sep 09 23:19:29.824266 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.824245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54dfe097-4ef6-43f9-990c-501eb1560ec3-tls-cert\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.824362 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.824277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72xh\" (UniqueName: \"kubernetes.io/projected/54dfe097-4ef6-43f9-990c-501eb1560ec3-kube-api-access-j72xh\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.925456 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.925434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54dfe097-4ef6-43f9-990c-501eb1560ec3-tls-cert\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.925541 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.925465    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72xh\" (UniqueName: \"kubernetes.io/projected/54dfe097-4ef6-43f9-990c-501eb1560ec3-kube-api-access-j72xh\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.927724 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.927698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/54dfe097-4ef6-43f9-990c-501eb1560ec3-tls-cert\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:29.932046 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:29.932030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72xh\" (UniqueName: \"kubernetes.io/projected/54dfe097-4ef6-43f9-990c-501eb1560ec3-kube-api-access-j72xh\") pod \"authorino-7d65f5d5b8-g2mtx\" (UID: \"54dfe097-4ef6-43f9-990c-501eb1560ec3\") " pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:30.061194 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.061150    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx"
Sep 09 23:19:30.323444 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.323386    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d65f5d5b8-g2mtx"]
Sep 09 23:19:30.326700 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:19:30.326677    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54dfe097_4ef6_43f9_990c_501eb1560ec3.slice/crio-b46db1c44f6ea327b7724e466852800aa31a4314d73166e50367e9f3054baa98 WatchSource:0}: Error finding container b46db1c44f6ea327b7724e466852800aa31a4314d73166e50367e9f3054baa98: Status 404 returned error can't find the container with id b46db1c44f6ea327b7724e466852800aa31a4314d73166e50367e9f3054baa98
Sep 09 23:19:30.521270 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.521243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx" event={"ID":"54dfe097-4ef6-43f9-990c-501eb1560ec3","Type":"ContainerStarted","Data":"b46db1c44f6ea327b7724e466852800aa31a4314d73166e50367e9f3054baa98"}
Sep 09 23:19:30.521270 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.521267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:30.521645 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.521255    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:30.528982 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.528966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:30.531101 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.531087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:30.628541 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.628486    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnrsb\" (UniqueName: \"kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb\") pod \"e51faf4a-d354-414d-b59e-ca987cacd3d3\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") "
Sep 09 23:19:30.628622 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.628538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert\") pod \"e51faf4a-d354-414d-b59e-ca987cacd3d3\" (UID: \"e51faf4a-d354-414d-b59e-ca987cacd3d3\") "
Sep 09 23:19:30.628622 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.628573    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndqx9\" (UniqueName: \"kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9\") pod \"d7e3080c-50d7-4810-a5ae-414751812ea7\" (UID: \"d7e3080c-50d7-4810-a5ae-414751812ea7\") "
Sep 09 23:19:30.630521 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.630499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9" (OuterVolumeSpecName: "kube-api-access-ndqx9") pod "d7e3080c-50d7-4810-a5ae-414751812ea7" (UID: "d7e3080c-50d7-4810-a5ae-414751812ea7"). InnerVolumeSpecName "kube-api-access-ndqx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:19:30.630615 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.630529    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb" (OuterVolumeSpecName: "kube-api-access-lnrsb") pod "e51faf4a-d354-414d-b59e-ca987cacd3d3" (UID: "e51faf4a-d354-414d-b59e-ca987cacd3d3"). InnerVolumeSpecName "kube-api-access-lnrsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:19:30.630670 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.630625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e51faf4a-d354-414d-b59e-ca987cacd3d3" (UID: "e51faf4a-d354-414d-b59e-ca987cacd3d3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:19:30.730061 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.730041    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e51faf4a-d354-414d-b59e-ca987cacd3d3-tls-cert\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:19:30.730061 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.730062    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndqx9\" (UniqueName: \"kubernetes.io/projected/d7e3080c-50d7-4810-a5ae-414751812ea7-kube-api-access-ndqx9\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:19:30.730190 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:30.730072    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnrsb\" (UniqueName: \"kubernetes.io/projected/e51faf4a-d354-414d-b59e-ca987cacd3d3-kube-api-access-lnrsb\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:19:31.527035 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.527008    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-nbjqg"
Sep 09 23:19:31.527403 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.527043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx" event={"ID":"54dfe097-4ef6-43f9-990c-501eb1560ec3","Type":"ContainerStarted","Data":"c18430ebeee48066eba462786e952d6ecc30a6933cd4b4f8bfe2497d858cd384"}
Sep 09 23:19:31.527403 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.527272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-hjpth"
Sep 09 23:19:31.543734 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.543694    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d65f5d5b8-g2mtx" podStartSLOduration=2.176738395 podStartE2EDuration="2.543681411s" totalImagesPullingTime="366.943016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:31.542330044 +0000 UTC m=+770.149939727" watchObservedRunningTime="2026-09-09 23:19:31.543681411 +0000 UTC m=+770.151291069"
Sep 09 23:19:31.562908 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.562881    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-nbjqg"]
Sep 09 23:19:31.569204 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.569179    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-nbjqg"]
Sep 09 23:19:31.570663 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.570642    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:19:31.570830 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.570800    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-9qlm6" podUID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" containerName="authorino" containerID="cri-o://4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d" gracePeriod=30
Sep 09 23:19:31.591165 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.591137    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-hjpth"]
Sep 09 23:19:31.593164 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.593139    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-hjpth"]
Sep 09 23:19:31.814872 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.814852    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:19:31.838128 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.838096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxxd4\" (UniqueName: \"kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4\") pod \"b7e588fd-81cc-40be-bea5-7a7d9b4f0152\" (UID: \"b7e588fd-81cc-40be-bea5-7a7d9b4f0152\") "
Sep 09 23:19:31.839957 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.839929    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4" (OuterVolumeSpecName: "kube-api-access-fxxd4") pod "b7e588fd-81cc-40be-bea5-7a7d9b4f0152" (UID: "b7e588fd-81cc-40be-bea5-7a7d9b4f0152"). InnerVolumeSpecName "kube-api-access-fxxd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:19:31.939104 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.939080    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxxd4\" (UniqueName: \"kubernetes.io/projected/b7e588fd-81cc-40be-bea5-7a7d9b4f0152-kube-api-access-fxxd4\") on node \"ip-10-0-138-84.ec2.internal\" DevicePath \"\""
Sep 09 23:19:31.950797 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.950776    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e3080c-50d7-4810-a5ae-414751812ea7" path="/var/lib/kubelet/pods/d7e3080c-50d7-4810-a5ae-414751812ea7/volumes"
Sep 09 23:19:31.951021 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:31.951010    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e51faf4a-d354-414d-b59e-ca987cacd3d3" path="/var/lib/kubelet/pods/e51faf4a-d354-414d-b59e-ca987cacd3d3/volumes"
Sep 09 23:19:32.532349 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.532309    2578 generic.go:356] "Generic (PLEG): container finished" podID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" containerID="4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d" exitCode=0
Sep 09 23:19:32.532783 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.532359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9qlm6" event={"ID":"b7e588fd-81cc-40be-bea5-7a7d9b4f0152","Type":"ContainerDied","Data":"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"}
Sep 09 23:19:32.532783 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.532384    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-9qlm6"
Sep 09 23:19:32.532783 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.532393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-9qlm6" event={"ID":"b7e588fd-81cc-40be-bea5-7a7d9b4f0152","Type":"ContainerDied","Data":"4229a680ffa6c1b92df48aa3a0d6f26fe9edb748d556a34e318217309aa4c01d"}
Sep 09 23:19:32.532783 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.532413    2578 scope.go:117] "RemoveContainer" containerID="4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"
Sep 09 23:19:32.549489 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.549461    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:19:32.549767 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.549747    2578 scope.go:117] "RemoveContainer" containerID="4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"
Sep 09 23:19:32.550037 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:19:32.550013    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d\": container with ID starting with 4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d not found: ID does not exist" containerID="4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"
Sep 09 23:19:32.550167 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.550040    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d"} err="failed to get container status \"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d\": rpc error: code = NotFound desc = could not find container \"4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d\": container with ID starting with 4e5cc31da26348d2d3f4c1388744ca79d95ff6127ce5975ffa3fd8e6618d7b9d not found: ID does not exist"
Sep 09 23:19:32.552282 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:32.552264    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-9qlm6"]
Sep 09 23:19:33.951042 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:19:33.951010    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" path="/var/lib/kubelet/pods/b7e588fd-81cc-40be-bea5-7a7d9b4f0152/volumes"
Sep 09 23:20:14.918805 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.918739    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"]
Sep 09 23:20:14.919240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.919075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" containerName="authorino"
Sep 09 23:20:14.919240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.919089    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" containerName="authorino"
Sep 09 23:20:14.919240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.919193    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7e588fd-81cc-40be-bea5-7a7d9b4f0152" containerName="authorino"
Sep 09 23:20:14.922079 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.922060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:14.924317 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.924294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 23:20:14.924469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.924453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-46264\""
Sep 09 23:20:14.933066 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:14.933046    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"]
Sep 09 23:20:15.027559 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.027519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83bd8a-4a15-4a4f-8de2-68caeb680413-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.027733 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.027616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5f8c\" (UniqueName: \"kubernetes.io/projected/3c83bd8a-4a15-4a4f-8de2-68caeb680413-kube-api-access-p5f8c\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.128704 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.128664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5f8c\" (UniqueName: \"kubernetes.io/projected/3c83bd8a-4a15-4a4f-8de2-68caeb680413-kube-api-access-p5f8c\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.128863 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.128804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83bd8a-4a15-4a4f-8de2-68caeb680413-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.129505 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.129483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c83bd8a-4a15-4a4f-8de2-68caeb680413-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.137627 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.137585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5f8c\" (UniqueName: \"kubernetes.io/projected/3c83bd8a-4a15-4a4f-8de2-68caeb680413-kube-api-access-p5f8c\") pod \"payload-processing-5b54b7fbb7-2zhsf\" (UID: \"3c83bd8a-4a15-4a4f-8de2-68caeb680413\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.234070 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.234038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:15.514612 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.514569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"]
Sep 09 23:20:15.516852 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:20:15.516827    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c83bd8a_4a15_4a4f_8de2_68caeb680413.slice/crio-834ff61ebc163710f1ab76ebbc2db6689bb99ab4491b7aaedf8295b8aff9577c WatchSource:0}: Error finding container 834ff61ebc163710f1ab76ebbc2db6689bb99ab4491b7aaedf8295b8aff9577c: Status 404 returned error can't find the container with id 834ff61ebc163710f1ab76ebbc2db6689bb99ab4491b7aaedf8295b8aff9577c
Sep 09 23:20:15.707117 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:15.707070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf" event={"ID":"3c83bd8a-4a15-4a4f-8de2-68caeb680413","Type":"ContainerStarted","Data":"834ff61ebc163710f1ab76ebbc2db6689bb99ab4491b7aaedf8295b8aff9577c"}
Sep 09 23:20:17.719094 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:17.719056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf" event={"ID":"3c83bd8a-4a15-4a4f-8de2-68caeb680413","Type":"ContainerStarted","Data":"3fcd21ff763cd03678ffe229bb895b6b257027e7048a859597c40e69b11c6211"}
Sep 09 23:20:17.719541 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:17.719157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:17.737124 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:17.737024    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf" podStartSLOduration=1.77961093 podStartE2EDuration="3.737010021s" totalImagesPullingTime="1.957399091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:17.735564395 +0000 UTC m=+816.343174058" watchObservedRunningTime="2026-09-09 23:20:17.737010021 +0000 UTC m=+816.344619679"
Sep 09 23:20:24.752800 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.752744    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerID="6c95f3725b0c9d5c8625d8f9023a06ffa71c5c3570dcdfa821d14f8c3b86e089" exitCode=0
Sep 09 23:20:24.752800 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.752793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" event={"ID":"ef75dee5-8225-4c45-b8b5-90c9c462c56e","Type":"ContainerDied","Data":"6c95f3725b0c9d5c8625d8f9023a06ffa71c5c3570dcdfa821d14f8c3b86e089"}
Sep 09 23:20:24.753146 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.753130    2578 scope.go:117] "RemoveContainer" containerID="6c95f3725b0c9d5c8625d8f9023a06ffa71c5c3570dcdfa821d14f8c3b86e089"
Sep 09 23:20:24.753978 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.753953    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:20:24.754042 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.754014    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:20:24.754075 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:24.754053    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 09 23:20:25.761798 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:25.761760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" event={"ID":"ef75dee5-8225-4c45-b8b5-90c9c462c56e","Type":"ContainerStarted","Data":"7caef8ce18555528db89ac05be0c7f80df969b9c5790302d86cbb90067982fe3"}
Sep 09 23:20:26.276852 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:26.276820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:20:26.278009 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:26.277978    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-nlfrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:20:26.278171 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:26.278037    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podUID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:20:27.276742 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:27.276711    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-nlfrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:20:27.277101 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:27.276761    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podUID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:20:28.276694 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:28.276657    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-nlfrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:20:28.276859 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:28.276735    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podUID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:20:28.726623 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:28.726593    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2zhsf"
Sep 09 23:20:29.276034 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:29.275998    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-nlfrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:20:29.276235 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:29.276056    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podUID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:20:30.276683 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:30.276649    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-nlfrg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused" start-of-body=
Sep 09 23:20:30.277018 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:30.276703    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg" podUID="ef75dee5-8225-4c45-b8b5-90c9c462c56e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.28:15021/healthz/ready\": dial tcp 10.133.0.28:15021: connect: connection refused"
Sep 09 23:20:30.332279 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:30.332250    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:20:31.280658 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:31.280622    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:20:31.282374 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:31.282349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nlfrg"
Sep 09 23:20:56.099492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.099454    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"]
Sep 09 23:20:56.102853 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.102831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.105139 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.105117    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 23:20:56.105139 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.105132    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 23:20:56.106151 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.106135    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sbz4r\""
Sep 09 23:20:56.106201 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.106156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 23:20:56.112774 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.112752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"]
Sep 09 23:20:56.164933 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.164904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.165044 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.164957    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8kx4\" (UniqueName: \"kubernetes.io/projected/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-kube-api-access-l8kx4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.165044 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.164999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.165143 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.165040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.165143 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.165089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.165215 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.165155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266407 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8kx4\" (UniqueName: \"kubernetes.io/projected/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-kube-api-access-l8kx4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266683 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266683 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266885 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266860    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.266955 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266912    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.267000 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.266951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.268609 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.268580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.268906 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.268888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.273561 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.273542    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8kx4\" (UniqueName: \"kubernetes.io/projected/65a5fc2e-deb9-48b5-b9e8-15949c85a49c-kube-api-access-l8kx4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h\" (UID: \"65a5fc2e-deb9-48b5-b9e8-15949c85a49c\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.413877 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.413811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:20:56.682740 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.682717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"]
Sep 09 23:20:56.684904 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:20:56.684881    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a5fc2e_deb9_48b5_b9e8_15949c85a49c.slice/crio-ab8d8ed3825980558f5887801e048035943df7c8540a69258c5cc04f2412e21d WatchSource:0}: Error finding container ab8d8ed3825980558f5887801e048035943df7c8540a69258c5cc04f2412e21d: Status 404 returned error can't find the container with id ab8d8ed3825980558f5887801e048035943df7c8540a69258c5cc04f2412e21d
Sep 09 23:20:56.899338 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:56.899299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h" event={"ID":"65a5fc2e-deb9-48b5-b9e8-15949c85a49c","Type":"ContainerStarted","Data":"ab8d8ed3825980558f5887801e048035943df7c8540a69258c5cc04f2412e21d"}
Sep 09 23:20:57.906229 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:57.906189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h" event={"ID":"65a5fc2e-deb9-48b5-b9e8-15949c85a49c","Type":"ContainerStarted","Data":"fd52f7f9e12efbb3e1d0f9ec55a30a210e77c4673e81595e8927a8069ff33776"}
Sep 09 23:20:57.922571 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:20:57.922521    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h" podStartSLOduration=0.799926931 podStartE2EDuration="1.922506583s" totalImagesPullingTime="1.122579652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:57.920292266 +0000 UTC m=+856.527901924" watchObservedRunningTime="2026-09-09 23:20:57.922506583 +0000 UTC m=+856.530116241"
Sep 09 23:21:06.414966 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:06.414936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:21:06.415345 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:06.414989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:21:06.426834 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:06.426814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:21:06.963018 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:06.962992    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h"
Sep 09 23:21:11.788398 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.788367    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"]
Sep 09 23:21:11.791792 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.791771    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.793847 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.793827    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 23:21:11.801397 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.801376    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"]
Sep 09 23:21:11.896807 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.896768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sggq5\" (UniqueName: \"kubernetes.io/projected/750300c5-e449-434e-a59e-d9dc8ea8dffe-kube-api-access-sggq5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.896911 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.896824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.896911 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.896884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.897004 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.896919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.897051 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.897002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.897090 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.897054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/750300c5-e449-434e-a59e-d9dc8ea8dffe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998392 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/750300c5-e449-434e-a59e-d9dc8ea8dffe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggq5\" (UniqueName: \"kubernetes.io/projected/750300c5-e449-434e-a59e-d9dc8ea8dffe-kube-api-access-sggq5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998524 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998722 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998772 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998840 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998813    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:11.998937 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:11.998896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:12.000742 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.000718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/750300c5-e449-434e-a59e-d9dc8ea8dffe-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:12.001161 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.001141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/750300c5-e449-434e-a59e-d9dc8ea8dffe-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:12.005444 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.005422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sggq5\" (UniqueName: \"kubernetes.io/projected/750300c5-e449-434e-a59e-d9dc8ea8dffe-kube-api-access-sggq5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5\" (UID: \"750300c5-e449-434e-a59e-d9dc8ea8dffe\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:12.102874 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.102823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:12.374507 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.374484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"]
Sep 09 23:21:12.376196 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:21:12.376170    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750300c5_e449_434e_a59e_d9dc8ea8dffe.slice/crio-3ea59a470e7865eca092db70b89a6fe6ebee027407bea6dcdb386b5bc2e5d93e WatchSource:0}: Error finding container 3ea59a470e7865eca092db70b89a6fe6ebee027407bea6dcdb386b5bc2e5d93e: Status 404 returned error can't find the container with id 3ea59a470e7865eca092db70b89a6fe6ebee027407bea6dcdb386b5bc2e5d93e
Sep 09 23:21:12.980026 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.979997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5" event={"ID":"750300c5-e449-434e-a59e-d9dc8ea8dffe","Type":"ContainerStarted","Data":"4d54d539054777a0e78f7d23949670cce298ea2d9705c494d88ed4ccf2b636b6"}
Sep 09 23:21:12.980404 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.980042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5" event={"ID":"750300c5-e449-434e-a59e-d9dc8ea8dffe","Type":"ContainerStarted","Data":"3ea59a470e7865eca092db70b89a6fe6ebee027407bea6dcdb386b5bc2e5d93e"}
Sep 09 23:21:12.996516 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:12.996469    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5" podStartSLOduration=1.823717973 podStartE2EDuration="1.996453483s" totalImagesPullingTime="172.73551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:21:12.994907092 +0000 UTC m=+871.602516776" watchObservedRunningTime="2026-09-09 23:21:12.996453483 +0000 UTC m=+871.604063158"
Sep 09 23:21:22.103855 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:22.103821    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:22.104225 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:22.103892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:22.115703 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:22.115681    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:23.034675 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:23.034650    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5"
Sep 09 23:21:37.594903 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.594816    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"]
Sep 09 23:21:37.597674 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.597653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.600169 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.600149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 23:21:37.607479 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.607458    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"]
Sep 09 23:21:37.700756 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.700857 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.700857 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.700930 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmfk\" (UniqueName: \"kubernetes.io/projected/49f9bd8d-ef2d-486f-a9e0-20694d970f12-kube-api-access-vnmfk\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.700962 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.700962 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.700953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801710 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmfk\" (UniqueName: \"kubernetes.io/projected/49f9bd8d-ef2d-486f-a9e0-20694d970f12-kube-api-access-vnmfk\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.801867 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.801839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.802214 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.802147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.802214 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.802201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.802307 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.802262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.803910 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.803883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/49f9bd8d-ef2d-486f-a9e0-20694d970f12-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.804161 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.804146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49f9bd8d-ef2d-486f-a9e0-20694d970f12-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.808985 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.808964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmfk\" (UniqueName: \"kubernetes.io/projected/49f9bd8d-ef2d-486f-a9e0-20694d970f12-kube-api-access-vnmfk\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-wqq89\" (UID: \"49f9bd8d-ef2d-486f-a9e0-20694d970f12\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:37.920048 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:37.919995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:38.187367 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:38.187347    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"]
Sep 09 23:21:38.189374 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:21:38.189350    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49f9bd8d_ef2d_486f_a9e0_20694d970f12.slice/crio-9e70bebff7f61c2e2a57d5ac388844131f94f186ce23ba23ccde65f47386388c WatchSource:0}: Error finding container 9e70bebff7f61c2e2a57d5ac388844131f94f186ce23ba23ccde65f47386388c: Status 404 returned error can't find the container with id 9e70bebff7f61c2e2a57d5ac388844131f94f186ce23ba23ccde65f47386388c
Sep 09 23:21:39.100247 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:39.100218    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="793e1a0dafe87074b29d547a328f2d8984a1a562211c7b6dbd24decbc7a376f8" exitCode=0
Sep 09 23:21:39.100716 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:39.100263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"793e1a0dafe87074b29d547a328f2d8984a1a562211c7b6dbd24decbc7a376f8"}
Sep 09 23:21:39.100716 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:39.100285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerStarted","Data":"9e70bebff7f61c2e2a57d5ac388844131f94f186ce23ba23ccde65f47386388c"}
Sep 09 23:21:39.100716 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:39.100557    2578 scope.go:117] "RemoveContainer" containerID="793e1a0dafe87074b29d547a328f2d8984a1a562211c7b6dbd24decbc7a376f8"
Sep 09 23:21:40.105928 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:40.105894    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7" exitCode=0
Sep 09 23:21:40.106319 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:40.105941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"}
Sep 09 23:21:40.106319 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:40.105971    2578 scope.go:117] "RemoveContainer" containerID="793e1a0dafe87074b29d547a328f2d8984a1a562211c7b6dbd24decbc7a376f8"
Sep 09 23:21:40.106319 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:40.106201    2578 scope.go:117] "RemoveContainer" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"
Sep 09 23:21:40.106432 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:21:40.106379    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:21:41.112809 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:41.112783    2578 scope.go:117] "RemoveContainer" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"
Sep 09 23:21:41.113183 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:21:41.112938    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:21:47.920135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:47.920087    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:47.920135 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:47.920146    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:47.920601 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:47.920156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:47.920601 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:47.920166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:21:47.920601 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:21:47.920457    2578 scope.go:117] "RemoveContainer" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"
Sep 09 23:21:47.920601 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:21:47.920586    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:02.946600 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:02.946572    2578 scope.go:117] "RemoveContainer" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"
Sep 09 23:22:03.211921 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:03.211899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerStarted","Data":"c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"}
Sep 09 23:22:03.227557 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:03.227514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podStartSLOduration=25.714634586 podStartE2EDuration="26.227498841s" totalImagesPullingTime="512.864255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:21:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:03.226318337 +0000 UTC m=+921.833927995" watchObservedRunningTime="2026-09-09 23:22:03.227498841 +0000 UTC m=+921.835108499"
Sep 09 23:22:04.217509 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:04.217482    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f" exitCode=0
Sep 09 23:22:04.217938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:04.217523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"}
Sep 09 23:22:04.217938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:04.217558    2578 scope.go:117] "RemoveContainer" containerID="1f1347bd17f42ce92e5c218e6b295c2a6ca2d634a5b494069b94084b0ca9eac7"
Sep 09 23:22:04.217938 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:04.217882    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:04.218187 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:04.218068    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:07.920596 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:07.920568    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:07.921049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:07.920619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:07.921049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:07.920632    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:07.921049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:07.920643    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:07.921049 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:07.920959    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:07.921275 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:07.921171    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:08.235779 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:08.235756    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:08.235985 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:08.235889    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:19.946492 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:19.946461    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:19.946855 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:19.946609    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:31.947843 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:31.947813    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:32.340449 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:32.340427    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325" exitCode=0
Sep 09 23:22:32.340548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:32.340472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"}
Sep 09 23:22:32.340548 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:32.340507    2578 scope.go:117] "RemoveContainer" containerID="c4ff773b283247188802abedfe8f9739fa8a1343cde53a1129fd6da506fda28f"
Sep 09 23:22:32.340784 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:32.340767    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:22:32.340945 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:32.340927    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:37.920300 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:37.920262    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:37.920300 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:37.920314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:37.920687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:37.920326    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:37.920687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:37.920335    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:22:37.920687 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:37.920608    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:22:37.920780 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:37.920743    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:22:49.946702 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:22:49.946672    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:22:49.947173 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:22:49.946825    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:00.946295 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:00.946267    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:23:00.946704 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:00.946410    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:12.945674 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:12.945604    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:23:12.946076 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:12.945844    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:23:13.526891 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:13.526833    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91" exitCode=0
Sep 09 23:23:13.526986 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:13.526905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"}
Sep 09 23:23:13.526986 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:13.526954    2578 scope.go:117] "RemoveContainer" containerID="772a704739daaeaec731779b97d26c4b613352ad88f9d5d710dc4ddda4f33325"
Sep 09 23:23:13.527339 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:13.527320    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:23:13.527484 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:13.527468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:17.921087 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:17.921060    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:23:17.921469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:17.921101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:23:17.921469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:17.921129    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:23:17.921469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:17.921140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:23:17.921469 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:17.921401    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:23:17.921597 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:17.921540    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:30.946694 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:30.946667    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:23:30.947129 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:30.946799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:41.947865 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:41.947836    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:23:41.948259 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:41.947974    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:23:54.945819 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:23:54.945793    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:23:54.946257 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:23:54.945938    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:24:07.946029 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:07.945993    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:24:07.946459 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:24:07.946172    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:24:22.946130 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:22.946086    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:24:22.946477 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:24:22.946290    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:24:36.946477 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:36.946408    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:24:37.893216 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.893185    2578 generic.go:356] "Generic (PLEG): container finished" podID="49f9bd8d-ef2d-486f-a9e0-20694d970f12" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3" exitCode=0
Sep 09 23:24:37.893354 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.893263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" event={"ID":"49f9bd8d-ef2d-486f-a9e0-20694d970f12","Type":"ContainerDied","Data":"74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"}
Sep 09 23:24:37.893354 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.893306    2578 scope.go:117] "RemoveContainer" containerID="776f952fb69d56ac2894a61f77d5205544503e752bb8286407df4674bd702e91"
Sep 09 23:24:37.893620 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.893595    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:24:37.893772 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:24:37.893754    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:24:37.920360 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.920330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:24:37.920451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.920383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:24:37.920451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.920394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:24:37.920451 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:37.920402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89"
Sep 09 23:24:38.899590 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:38.899560    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:24:38.899947 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:24:38.899693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:24:52.945790 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:24:52.945764    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:24:52.946214 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:24:52.945905    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:04.946591 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:04.946563    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:25:04.947016 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:25:04.946707    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:17.945910 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:17.945881    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:25:17.946363 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:25:17.946079    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:28.463444 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:28.463405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d65f5d5b8-g2mtx_54dfe097-4ef6-43f9-990c-501eb1560ec3/authorino/0.log"
Sep 09 23:25:28.946151 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:28.946072    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:25:28.946276 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:25:28.946233    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:33.595904 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:33.595875    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vkqxq_ddc7ddef-8a00-46ef-84c1-5ab468437c0b/manager/0.log"
Sep 09 23:25:33.713455 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:33.713423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nfhw7_f9a8bfdd-f029-434b-b09a-4a97443991f7/manager/0.log"
Sep 09 23:25:33.948157 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:33.948073    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gg6x5_9c32e1dd-3e14-426b-9eb6-c8158c91a3a6/server/0.log"
Sep 09 23:25:34.070141 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:34.070102    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sdfp4_66b92bda-269b-4474-9590-ccaefd26b70d/manager/0.log"
Sep 09 23:25:34.297329 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:34.297304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c5b764bdf-g6tv7_4592cfee-0251-4ef6-abce-ba20998e97ed/copy-manifests/0.log"
Sep 09 23:25:34.303707 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:34.303685    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c5b764bdf-g6tv7_4592cfee-0251-4ef6-abce-ba20998e97ed/manager/0.log"
Sep 09 23:25:35.629887 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:35.629857    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d65f5d5b8-g2mtx_54dfe097-4ef6-43f9-990c-501eb1560ec3/authorino/0.log"
Sep 09 23:25:35.735908 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:35.735881    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-dkz9z_f35ace3a-328c-4127-aac1-77fa1aa03edd/manager/0.log"
Sep 09 23:25:36.095690 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:36.095666    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-n5g62_5e60e870-1052-4c2e-aaf3-7b713c0be1d4/manager/0.log"
Sep 09 23:25:36.317898 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:36.317873    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rmgpt_9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c/manager/0.log"
Sep 09 23:25:36.666978 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:36.666948    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5_9945df4f-4f97-4edc-aa52-8550a99edb0e/istio-proxy/0.log"
Sep 09 23:25:36.896146 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:36.896104    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddf9d86bc-p28ck_66401faf-b459-4ca2-80f9-12a87604a534/kube-auth-proxy/0.log"
Sep 09 23:25:37.124650 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:37.124627    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/1.log"
Sep 09 23:25:37.343951 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:37.343927    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2zhsf_3c83bd8a-4a15-4a4f-8de2-68caeb680413/payload-processing/0.log"
Sep 09 23:25:38.006791 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:38.006768    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-lr22h_65a5fc2e-deb9-48b5-b9e8-15949c85a49c/main/0.log"
Sep 09 23:25:38.228589 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:38.228563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffvwg5_750300c5-e449-434e-a59e-d9dc8ea8dffe/main/0.log"
Sep 09 23:25:38.441443 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:38.441384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_49f9bd8d-ef2d-486f-a9e0-20694d970f12/main/5.log"
Sep 09 23:25:42.946311 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:42.946285    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:25:42.946640 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:25:42.946446    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:46.611429 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:46.611397    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bvw4w_edb270ef-73e9-4ffe-b404-10113db3a147/global-pull-secret-syncer/0.log"
Sep 09 23:25:46.806811 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:46.806787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zvhhj_d7d1adce-1c01-45a7-b895-e7697102a6f6/konnectivity-agent/0.log"
Sep 09 23:25:46.876070 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:46.876014    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-84.ec2.internal_f40080e6fa7848a7df4ac3ee5efb921c/haproxy/0.log"
Sep 09 23:25:51.083377 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:51.083351    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d65f5d5b8-g2mtx_54dfe097-4ef6-43f9-990c-501eb1560ec3/authorino/0.log"
Sep 09 23:25:51.108672 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:51.108645    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-dkz9z_f35ace3a-328c-4127-aac1-77fa1aa03edd/manager/0.log"
Sep 09 23:25:51.196907 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:51.196886    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-n5g62_5e60e870-1052-4c2e-aaf3-7b713c0be1d4/manager/0.log"
Sep 09 23:25:51.262085 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:51.262065    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rmgpt_9bd64e0d-b4bb-4cf6-b441-b8487f5d5a0c/manager/0.log"
Sep 09 23:25:53.067771 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:53.067742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85dc8dc659-rb6q2_7d676a22-eba0-4c58-8fa8-76691ee231bd/metrics-server/0.log"
Sep 09 23:25:53.271432 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:53.271407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbnm8_60561de0-3f36-4ba9-9b60-5ea01635aae6/node-exporter/0.log"
Sep 09 23:25:53.290247 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:53.290216    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbnm8_60561de0-3f36-4ba9-9b60-5ea01635aae6/kube-rbac-proxy/0.log"
Sep 09 23:25:53.309653 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:53.309636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbnm8_60561de0-3f36-4ba9-9b60-5ea01635aae6/init-textfile/0.log"
Sep 09 23:25:55.946365 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:55.946333    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:25:55.946711 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:25:55.946478    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:25:57.073985 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.073948    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"]
Sep 09 23:25:57.077415 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.077392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.079544 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.079518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njqsq\"/\"kube-root-ca.crt\""
Sep 09 23:25:57.079654 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.079518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njqsq\"/\"openshift-service-ca.crt\""
Sep 09 23:25:57.079654 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.079647    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-njqsq\"/\"default-dockercfg-rjsgt\""
Sep 09 23:25:57.087323 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.087305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"]
Sep 09 23:25:57.149370 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.149349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-lib-modules\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.149457 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.149382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-sys\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.149457 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.149447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-proc\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.149537 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.149492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwttg\" (UniqueName: \"kubernetes.io/projected/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-kube-api-access-lwttg\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.149537 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.149519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-podres\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.249922 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.249900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwttg\" (UniqueName: \"kubernetes.io/projected/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-kube-api-access-lwttg\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250036 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.249932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-podres\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250036 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.249956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-lib-modules\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-podres\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250065    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-sys\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-lib-modules\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-proc\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250174 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250171    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-sys\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.250369 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.250205    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-proc\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.256726 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.256708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwttg\" (UniqueName: \"kubernetes.io/projected/88ed03cc-69df-4a66-9f2d-ab4bec467b1c-kube-api-access-lwttg\") pod \"perf-node-gather-daemonset-m9f5n\" (UID: \"88ed03cc-69df-4a66-9f2d-ab4bec467b1c\") " pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.386651 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.386599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:57.653057 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:57.652989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"]
Sep 09 23:25:57.656251 ip-10-0-138-84 kubenswrapper[2578]: W0909 23:25:57.656228    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod88ed03cc_69df_4a66_9f2d_ab4bec467b1c.slice/crio-5488a18afe3ef3e48dfeb7d325c4cf629c9eee80e9b2f108755624c9b7accb99 WatchSource:0}: Error finding container 5488a18afe3ef3e48dfeb7d325c4cf629c9eee80e9b2f108755624c9b7accb99: Status 404 returned error can't find the container with id 5488a18afe3ef3e48dfeb7d325c4cf629c9eee80e9b2f108755624c9b7accb99
Sep 09 23:25:58.234239 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.234208    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n" event={"ID":"88ed03cc-69df-4a66-9f2d-ab4bec467b1c","Type":"ContainerStarted","Data":"3bffbbbc9586bc509098eb66dacd6c759e8ffdbb348499b085db7d5475a97f2d"}
Sep 09 23:25:58.234582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.234257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n" event={"ID":"88ed03cc-69df-4a66-9f2d-ab4bec467b1c","Type":"ContainerStarted","Data":"5488a18afe3ef3e48dfeb7d325c4cf629c9eee80e9b2f108755624c9b7accb99"}
Sep 09 23:25:58.234582 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.234283    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:25:58.249387 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.249343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n" podStartSLOduration=1.249328373 podStartE2EDuration="1.249328373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:25:58.247346034 +0000 UTC m=+1156.854955692" watchObservedRunningTime="2026-09-09 23:25:58.249328373 +0000 UTC m=+1156.856938032"
Sep 09 23:25:58.513673 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.513614    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9knhx_3d254c16-5057-415c-914d-dafc2bcc33b1/dns/0.log"
Sep 09 23:25:58.531383 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.531366    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9knhx_3d254c16-5057-415c-914d-dafc2bcc33b1/kube-rbac-proxy/0.log"
Sep 09 23:25:58.638532 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:58.638509    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t9wcg_d586165e-169f-46fd-ae66-088ce2cfd7f4/dns-node-resolver/0.log"
Sep 09 23:25:59.118000 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:59.117972    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d969b696f-w4lhl_d8b0249c-bdb5-4e05-b143-7cd3e35c83dd/registry/0.log"
Sep 09 23:25:59.136661 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:25:59.136635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cd426_830fe17e-6cc1-4c9d-a7c8-c3a087eefcbf/node-ca/0.log"
Sep 09 23:26:00.045405 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.045373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5_9945df4f-4f97-4edc-aa52-8550a99edb0e/istio-proxy/0.log"
Sep 09 23:26:00.106658 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.106631    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddf9d86bc-p28ck_66401faf-b459-4ca2-80f9-12a87604a534/kube-auth-proxy/0.log"
Sep 09 23:26:00.152944 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.152922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/1.log"
Sep 09 23:26:00.153664 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.153645    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/0.log"
Sep 09 23:26:00.192074 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.192045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2zhsf_3c83bd8a-4a15-4a4f-8de2-68caeb680413/payload-processing/0.log"
Sep 09 23:26:00.828950 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:00.828930    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwnj8_bf2fd60d-6a70-43fb-9180-f46fdc89a905/serve-healthcheck-canary/0.log"
Sep 09 23:26:01.298120 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:01.298078    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2gqc7_261cffcd-e4c2-4774-adc3-c70f6c1991a6/kube-rbac-proxy/0.log"
Sep 09 23:26:01.318263 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:01.318235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2gqc7_261cffcd-e4c2-4774-adc3-c70f6c1991a6/exporter/0.log"
Sep 09 23:26:01.336947 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:01.336923    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2gqc7_261cffcd-e4c2-4774-adc3-c70f6c1991a6/extractor/0.log"
Sep 09 23:26:03.540202 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.540174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vkqxq_ddc7ddef-8a00-46ef-84c1-5ab468437c0b/manager/0.log"
Sep 09 23:26:03.590095 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.590068    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nfhw7_f9a8bfdd-f029-434b-b09a-4a97443991f7/manager/0.log"
Sep 09 23:26:03.636447 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.636423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gg6x5_9c32e1dd-3e14-426b-9eb6-c8158c91a3a6/server/0.log"
Sep 09 23:26:03.699818 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.699798    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sdfp4_66b92bda-269b-4474-9590-ccaefd26b70d/manager/0.log"
Sep 09 23:26:03.762015 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.761995    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c5b764bdf-g6tv7_4592cfee-0251-4ef6-abce-ba20998e97ed/manager/0.log"
Sep 09 23:26:03.778147 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:03.778130    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c5b764bdf-g6tv7_4592cfee-0251-4ef6-abce-ba20998e97ed/copy-manifests/0.log"
Sep 09 23:26:04.247962 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:04.247937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-njqsq/perf-node-gather-daemonset-m9f5n"
Sep 09 23:26:06.624935 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:06.624895    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5_9945df4f-4f97-4edc-aa52-8550a99edb0e/istio-proxy/0.log"
Sep 09 23:26:06.688578 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:06.688555    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddf9d86bc-p28ck_66401faf-b459-4ca2-80f9-12a87604a534/kube-auth-proxy/0.log"
Sep 09 23:26:06.726979 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:06.726959    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/1.log"
Sep 09 23:26:06.727858 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:06.727840    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/0.log"
Sep 09 23:26:06.756058 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:06.756006    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2zhsf_3c83bd8a-4a15-4a4f-8de2-68caeb680413/payload-processing/0.log"
Sep 09 23:26:07.885610 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:07.885580    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cmm8z5_9945df4f-4f97-4edc-aa52-8550a99edb0e/istio-proxy/0.log"
Sep 09 23:26:07.934258 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:07.934233    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ddf9d86bc-p28ck_66401faf-b459-4ca2-80f9-12a87604a534/kube-auth-proxy/0.log"
Sep 09 23:26:07.946144 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:07.946126    2578 scope.go:117] "RemoveContainer" containerID="74efd20b3999d3cba49c220e125255aace8e34b7f064dcf48e9ace1c9b7936d3"
Sep 09 23:26:07.946301 ip-10-0-138-84 kubenswrapper[2578]: E0909 23:26:07.946279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-wqq89_llm(49f9bd8d-ef2d-486f-a9e0-20694d970f12)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-wqq89" podUID="49f9bd8d-ef2d-486f-a9e0-20694d970f12"
Sep 09 23:26:07.976534 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:07.976514    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/1.log"
Sep 09 23:26:07.977275 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:07.977252    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-nlfrg_ef75dee5-8225-4c45-b8b5-90c9c462c56e/istio-proxy/0.log"
Sep 09 23:26:08.003518 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:08.003497    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2zhsf_3c83bd8a-4a15-4a4f-8de2-68caeb680413/payload-processing/0.log"
Sep 09 23:26:11.560263 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.560233    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/kube-multus-additional-cni-plugins/0.log"
Sep 09 23:26:11.583359 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.583333    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/egress-router-binary-copy/0.log"
Sep 09 23:26:11.601892 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.601874    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/cni-plugins/0.log"
Sep 09 23:26:11.620254 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.620234    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/bond-cni-plugin/0.log"
Sep 09 23:26:11.638425 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.638407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/routeoverride-cni/0.log"
Sep 09 23:26:11.656299 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.656277    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/whereabouts-cni-bincopy/0.log"
Sep 09 23:26:11.674907 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.674888    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nsmgq_d85130e3-071d-454d-9199-3125c46a4ebc/whereabouts-cni/0.log"
Sep 09 23:26:11.846240 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.846186    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d898d_bd7b11f2-ddde-4719-bf8f-2fba993e822c/kube-multus/0.log"
Sep 09 23:26:11.888656 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.888636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dkvjn_cb517cf6-6b04-4901-bc1d-4b37f5302657/network-metrics-daemon/0.log"
Sep 09 23:26:11.904725 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:11.904708    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dkvjn_cb517cf6-6b04-4901-bc1d-4b37f5302657/kube-rbac-proxy/0.log"
Sep 09 23:26:13.125868 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.125836    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/ovn-controller/0.log"
Sep 09 23:26:13.139842 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.139817    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/ovn-acl-logging/0.log"
Sep 09 23:26:13.164531 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.164506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/kube-rbac-proxy-node/0.log"
Sep 09 23:26:13.186475 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.186452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 23:26:13.200957 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.200938    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/northd/0.log"
Sep 09 23:26:13.218471 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.218451    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/nbdb/0.log"
Sep 09 23:26:13.237000 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.236982    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/sbdb/0.log"
Sep 09 23:26:13.285078 ip-10-0-138-84 kubenswrapper[2578]: I0909 23:26:13.285055    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vgrqf_536bc265-2185-4109-a0a4-2762b47b0ecf/ovnkube-controller/0.log"