Sep 09 23:07:24.633644 ip-10-0-143-254 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 23:07:24.633654 ip-10-0-143-254 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 23:07:24.633661 ip-10-0-143-254 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 23:07:24.633802 ip-10-0-143-254 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 23:07:34.740849 ip-10-0-143-254 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 23:07:34.740871 ip-10-0-143-254 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6df34922853949cea5e2d98b6fc21cea --
Sep 09 23:09:03.259178 ip-10-0-143-254 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 23:09:03.707155 ip-10-0-143-254 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:09:03.707155 ip-10-0-143-254 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 23:09:03.707155 ip-10-0-143-254 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:09:03.707155 ip-10-0-143-254 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 23:09:03.707155 ip-10-0-143-254 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 23:09:03.710080 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.709988    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 23:09:03.714081 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714061    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.714081 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714077    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.714081 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714082    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.714081 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714086    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714091    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714096    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714099    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714103    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714107    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714111    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714115    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714121    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714125    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714129    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714132    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714137    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714141    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714145    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714151    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714155    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714159    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714164    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714168    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.714313 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714172    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714176    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714180    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714184    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714188    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714192    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714196    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714200    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714205    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714209    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714213    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714218    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714223    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714229    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714234    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714239    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714244    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714248    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714253    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714257    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.715034 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714261    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714266    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714272    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714275    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714280    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714284    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714289    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714297    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714303    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714307    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714312    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714317    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714321    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714326    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714330    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714335    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714339    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714343    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714350    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.715522 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714355    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714361    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714366    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714370    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714375    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714379    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714383    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714388    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714393    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714398    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714403    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714407    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714411    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714416    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714420    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714426    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714431    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714435    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714439    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714443    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.716005 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714448    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714452    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714456    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714461    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714465    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714470    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714475    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714481    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714488    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714492    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714496    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714501    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714505    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714509    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714514    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714518    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.714523    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715468    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715479    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715483    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.716527 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715486    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715490    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715493    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715496    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715499    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715502    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715505    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715508    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715511    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715516    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715520    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715524    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715527    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715531    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715533    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715536    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715540    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715543    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715548    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.717055 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715550    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715553    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715556    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715558    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715561    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715564    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715567    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715569    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715572    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715574    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715577    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715582    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715585    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715588    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715591    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715594    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715596    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715599    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715602    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715604    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.717540 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715607    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715610    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715613    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715615    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715618    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715621    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715623    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715626    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715629    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715631    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715635    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715637    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715640    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715643    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715645    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715648    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715650    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715653    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715656    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715658    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.718052 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715661    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715664    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715667    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715671    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715676    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715680    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715684    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715686    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715689    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715692    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715695    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715697    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715700    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715703    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715706    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715709    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715712    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715714    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715717    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715720    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.718554 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715723    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715726    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715728    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715731    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715734    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715736    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715741    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715744    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715747    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715749    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715752    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715754    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715757    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715760    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715764    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715767    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.715770    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716212    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716218    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716222    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.719073 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716225    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716229    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716231    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716234    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716237    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716240    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716242    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716245    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716248    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716251    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716253    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716256    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716259    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716261    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716264    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716267    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716270    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716272    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716277    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716279    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.719553 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716282    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716285    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716287    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716290    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716293    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716295    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716299    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716302    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716305    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716308    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716312    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716315    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716318    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716321    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716324    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716327    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716330    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716333    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716336    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.720065 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716339    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716342    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716345    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716349    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716352    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716355    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716358    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716360    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716363    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716365    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716368    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716372    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716375    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716377    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716380    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716383    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716385    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716388    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716391    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716395    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.720530 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716398    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716401    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716403    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716409    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716412    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716415    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716417    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716420    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716423    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716425    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716428    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716431    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716433    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716436    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716439    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716441    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716444    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716447    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716449    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716452    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.721042 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716455    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716459    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716463    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716467    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716469    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716474    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716477    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716480    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716483    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716486    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716489    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716493    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716495    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716498    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716501    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716503    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.716506    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716570    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716609    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716615    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 23:09:03.721650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716621    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716625    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716628    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716633    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716637    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716641    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716644    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716647    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716651    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716655    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716658    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716661    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716665    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716668    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716671    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716676    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716679    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716683    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716686    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716689    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716693    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716697    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716700    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 23:09:03.722156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716704    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716707    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716710    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716713    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716717    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716719    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716724    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716727    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716730    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716733    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716736    2564 flags.go:64] FLAG: --enable-server="true"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716739    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716744    2564 flags.go:64] FLAG: --event-burst="100"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716747    2564 flags.go:64] FLAG: --event-qps="50"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716750    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716754    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716757    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716760    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716763    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716766    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716769    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716772    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716776    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716779    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716782    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 23:09:03.722745 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716786    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716789    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716792    2564 flags.go:64] FLAG: --feature-gates=""
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716796    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716799    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716802    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716805    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716809    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716812    2564 flags.go:64] FLAG: --help="false"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716815    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-143-254.ec2.internal"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716818    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716822    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716825    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716828    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716838    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716841    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716844    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716847    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716850    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716852    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716856    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716859    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716862    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716878    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 23:09:03.723399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716881    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716884    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716887    2564 flags.go:64] FLAG: --lock-file=""
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716891    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716894    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716897    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716903    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716906    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716910    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716919    2564 flags.go:64] FLAG: --logging-format="text"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716923    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716927    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716930    2564 flags.go:64] FLAG: --manifest-url=""
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716933    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716937    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716941    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716945    2564 flags.go:64] FLAG: --max-pods="110"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716948    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716951    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716954    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716957    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716960    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716963    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716967    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716980    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 23:09:03.724015 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716983    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716986    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716990    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716993    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.716999    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717002    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717005    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717008    2564 flags.go:64] FLAG: --port="10250"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717011    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717014    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a01faf1214c1b49"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717018    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717021    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717024    2564 flags.go:64] FLAG: --register-node="true"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717027    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717031    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717034    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717037    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717040    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717044    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717048    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717051    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717054    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717057    2564 flags.go:64] FLAG: --runonce="false"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717061    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717064    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 23:09:03.724636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717067    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717070    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717074    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717077    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717080    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717083    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717087    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717090    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717093    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717096    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717100    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717103    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717106    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717113    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717117    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717120    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717124    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717127    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717130    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717133    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717136    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717139    2564 flags.go:64] FLAG: --v="2"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717145    2564 flags.go:64] FLAG: --version="false"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717149    2564 flags.go:64] FLAG: --vmodule=""
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717153    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 23:09:03.725307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.717156    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717273    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717277    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717282    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717286    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717289    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717291    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717295    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717297    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717300    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717303    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717305    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717308    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717311    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717315    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717317    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717320    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717323    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717325    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.725927 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717328    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717333    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717336    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717339    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717341    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717345    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717349    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717352    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717355    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717358    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717363    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717366    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717368    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717371    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717374    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717377    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717380    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717383    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717385    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.726404 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717388    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717391    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717394    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717396    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717399    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717402    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717404    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717407    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717409    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717412    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717415    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717418    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717420    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717423    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717427    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717430    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717432    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717435    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717438    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717440    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.726894 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717443    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717446    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717448    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717452    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717455    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717458    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717461    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717463    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717466    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717469    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717472    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717474    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717477    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717480    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717482    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717485    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717488    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717492    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717495    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717498    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.727402 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717501    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717504    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717507    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717510    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717512    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717515    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717519    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717522    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717524    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717527    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717530    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717532    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717535    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717538    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717540    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717545    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717548    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717550    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717553    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717556    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.727912 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717559    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.717561    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.718260    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.726196    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.726217    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.727096    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.727104    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727167    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727173    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727176    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727179    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727182    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727185    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727188    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727191    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.728403 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727194    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727196    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727201    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727206    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727209    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727214    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727217    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727220    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727223    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727226    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727228    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727232    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727234    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727237    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727240    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727243    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727245    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727248    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727251    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727254    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.728817 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727257    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727267    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727271    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727273    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727276    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727279    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727282    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727285    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727287    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727290    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727293    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727295    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727298    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727301    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727303    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727306    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727309    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727311    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727315    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727319    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.729346 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727322    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727324    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727327    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727330    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727333    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727335    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727338    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727341    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727343    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727346    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727348    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727351    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727354    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727358    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727368    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727371    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727374    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727377    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727380    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.729839 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727383    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727386    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727388    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727391    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727394    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727397    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727399    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727402    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727405    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727408    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727411    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727414    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727416    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727419    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727422    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727425    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727427    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727430    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727433    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727436    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.730328 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727438    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727441    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727445    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727453    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727456    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727460    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727463    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727466    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727474    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727477    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727479    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727484    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.727490    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727646    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 23:09:03.730824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727651    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727654    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727657    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727661    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727663    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727666    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727669    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727672    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727674    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727677    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727680    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727683    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727685    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727688    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727690    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727693    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727696    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727698    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727701    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 23:09:03.731195 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727704    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727706    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727709    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727711    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727715    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727718    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727721    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727724    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727732    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727735    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727737    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727740    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727743    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727745    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727748    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727751    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727754    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727756    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727759    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727761    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 23:09:03.731659 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727764    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727767    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727770    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727772    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727775    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727778    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727780    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727783    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727786    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727788    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727791    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727793    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727796    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727798    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727802    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727806    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727809    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727812    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727816    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 23:09:03.732163 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727818    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727823    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727833    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727836    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727840    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727844    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727847    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727850    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727853    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727856    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727859    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727862    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727878    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727882    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727884    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727887    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727889    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727892    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727894    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 23:09:03.732621 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727897    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727900    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727902    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727905    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727907    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727910    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727913    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727916    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727919    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727922    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727925    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727928    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727931    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727934    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727936    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727939    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727948    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727950    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727953    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727956    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 23:09:03.733132 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:03.727958    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.727963    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.728101    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.730567    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.731597    2564 server.go:1019] "Starting client certificate rotation"
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.731698    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:09:03.733618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.731763    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 23:09:03.738976 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.738931    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:09:03.745546 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.745524    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 23:09:03.761390 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.761369    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 09 23:09:03.764652 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.764628    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:09:03.764896 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.764859    2564 log.go:25] "Validated CRI v1 image API"
Sep 09 23:09:03.765757 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.765742    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 23:09:03.768201 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.768178    2564 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8fc44886-8f03-47f7-aee6-bd8c433989bb:/dev/nvme0n1p4 e2c1fe08-8e30-476f-b437-bb3e4c1b9c8f:/dev/nvme0n1p3]
Sep 09 23:09:03.768246 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.768201    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 23:09:03.774402 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.774294    2564 manager.go:216] Machine: {Timestamp:2026-09-09 23:09:03.772891995 +0000 UTC m=+0.381258993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108786 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8fb73042134e1d623fc84963b486 SystemUUID:ec2a8fb7-3042-134e-1d62-3fc84963b486 BootID:6df34922-8539-49ce-a5e2-d98b6fc21cea Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:09:20:c1:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:09:20:c1:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:5a:ba:1f:b0:b9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 23:09:03.774402 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.774398    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 23:09:03.774549 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.774479    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 23:09:03.778347 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.778324    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 23:09:03.778486 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.778350    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-254.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 23:09:03.779244 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.779234    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 23:09:03.779286 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.779246    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 23:09:03.779286 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.779254    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:09:03.780040 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.780030    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 23:09:03.781930 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.781920    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 23:09:03.786491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786480    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:09:03.786596 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786588    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 23:09:03.786638 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786620    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 23:09:03.786673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786641    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 23:09:03.786673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786653    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 23:09:03.786673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786668    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 09 23:09:03.786792 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.786676    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 23:09:03.787065 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.787054    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:09:03.787125 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.787074    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 23:09:03.789677 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.789660    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 23:09:03.792481 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792466    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 23:09:03.792541 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792497    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 23:09:03.792658 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792648    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 23:09:03.792694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792663    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 23:09:03.792694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792670    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 23:09:03.792694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792676    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 23:09:03.792694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792684    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 23:09:03.792694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.792690    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 23:09:03.793343 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793332    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 23:09:03.793343 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793343    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 23:09:03.793410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793349    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 23:09:03.793410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793355    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 23:09:03.793410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793369    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 23:09:03.793410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.793377    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 23:09:03.795031 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.795018    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 23:09:03.795031 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.795028    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 23:09:03.798469 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.798451    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-254.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 23:09:03.798952 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.798919    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 23:09:03.799071 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.799047    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 23:09:03.799355 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.799329    2564 server.go:1268] "Started kubelet"
Sep 09 23:09:03.799923 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.799839    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 23:09:03.800041 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.799947    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 23:09:03.800100 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.800068    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 23:09:03.800368 ip-10-0-143-254 systemd[1]: Started Kubernetes Kubelet.
Sep 09 23:09:03.802365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.802346    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 23:09:03.803006 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.802987    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 23:09:03.806202 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.806180    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 23:09:03.811352 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.811334    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 23:09:03.812027 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812008    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 23:09:03.812214 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.812162    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:03.812721 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812704    2564 factory.go:55] Registering systemd factory
Sep 09 23:09:03.812721 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812721    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 09 23:09:03.812883 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812850    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 23:09:03.812960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812851    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 23:09:03.812960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812898    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 23:09:03.812960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812926    2564 factory.go:153] Registering CRI-O factory
Sep 09 23:09:03.812960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812944    2564 factory.go:223] Registration of the crio container factory successfully
Sep 09 23:09:03.813152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812992    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 23:09:03.813152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.813018    2564 factory.go:103] Registering Raw factory
Sep 09 23:09:03.813152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.813034    2564 manager.go:1196] Started watching for new ooms in manager
Sep 09 23:09:03.813152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.812993    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 23:09:03.813152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.813054    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 23:09:03.813453 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.813441    2564 manager.go:349] Starting recovery of all containers
Sep 09 23:09:03.814564 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.814545    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mm5n4"
Sep 09 23:09:03.818593 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.818406    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 23:09:03.818593 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.818537    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-254.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 23:09:03.819645 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.818351    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-254.ec2.internal.18d3c9c963fc020b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-254.ec2.internal,UID:ip-10-0-143-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-254.ec2.internal,},FirstTimestamp:2026-09-09 23:09:03.799288331 +0000 UTC m=+0.407655331,LastTimestamp:2026-09-09 23:09:03.799288331 +0000 UTC m=+0.407655331,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-254.ec2.internal,}"
Sep 09 23:09:03.822295 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.822271    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mm5n4"
Sep 09 23:09:03.823271 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.823256    2564 manager.go:354] Recovery completed
Sep 09 23:09:03.828428 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.828413    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.830272 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830255    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.830346 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830286    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.830346 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830297    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.830766 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830750    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 23:09:03.830766 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830763    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 23:09:03.830910 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830778    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 23:09:03.830910 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.830818    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.831466 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.831452    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.831518 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.831476    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.831518 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.831487    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.832708 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.832623    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-254.ec2.internal.18d3c9c965d4cc07  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-254.ec2.internal,UID:ip-10-0-143-254.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-254.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-254.ec2.internal,},FirstTimestamp:2026-09-09 23:09:03.830273031 +0000 UTC m=+0.438640031,LastTimestamp:2026-09-09 23:09:03.830273031 +0000 UTC m=+0.438640031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-254.ec2.internal,}"
Sep 09 23:09:03.832809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.832772    2564 policy_none.go:49] "None policy: Start"
Sep 09 23:09:03.832809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.832786    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 23:09:03.832809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.832801    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 23:09:03.834913 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.834899    2564 policy_none.go:47] "Start"
Sep 09 23:09:03.868503 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.868485    2564 manager.go:337] "Starting Device Plugin manager"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.868527    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.868541    2564 server.go:87] "Starting device plugin registration server"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.868895    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.868908    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.869269    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.869323    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.869328    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.870024    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.870064    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.884656    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.886004    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.886054    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.886080    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.886125    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 23:09:03.894579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.888309    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:09:03.969457 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.969433    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.972422 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.972396    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.972555 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.972435    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.972555 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.972450    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.972555 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.972474    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-254.ec2.internal"
Sep 09 23:09:03.986646 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.986620    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"]
Sep 09 23:09:03.986712 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.986706    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.987705 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.987691    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-254.ec2.internal"
Sep 09 23:09:03.987754 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:03.987712    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-254.ec2.internal\": node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:03.989553 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.989537    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.989635 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.989564    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.989635 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.989575    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.991997 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.991983    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.992119 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992105    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:03.992176 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992138    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.992741 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992727    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.992817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992756    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.992817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992770    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.992817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992782    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.992817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992798    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.992817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.992810    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:03.995210 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.995193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:03.995318 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.995218    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 23:09:03.996959 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.996944    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 23:09:03.997038 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.996971    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 23:09:03.997038 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:03.996984    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeHasSufficientPID"
Sep 09 23:09:04.014178 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.014156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.014267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.014184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.014267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.014202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a1b0e0c85c71eed0c06c4b54bd79641-config\") pod \"kube-apiserver-proxy-ip-10-0-143-254.ec2.internal\" (UID: \"7a1b0e0c85c71eed0c06c4b54bd79641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.021757 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.021740    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-254.ec2.internal\" not found" node="ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.026119 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.026104    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-254.ec2.internal\" not found" node="ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.041794 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.041778    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.114892 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.114856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.115026 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.114896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a1b0e0c85c71eed0c06c4b54bd79641-config\") pod \"kube-apiserver-proxy-ip-10-0-143-254.ec2.internal\" (UID: \"7a1b0e0c85c71eed0c06c4b54bd79641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.115026 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.114920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.115026 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.114986    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a1b0e0c85c71eed0c06c4b54bd79641-config\") pod \"kube-apiserver-proxy-ip-10-0-143-254.ec2.internal\" (UID: \"7a1b0e0c85c71eed0c06c4b54bd79641\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.115026 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.115013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.115026 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.114990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae436a8b1f6a6aee0446437ebc6f1294-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal\" (UID: \"ae436a8b1f6a6aee0446437ebc6f1294\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.142012 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.141985    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.242696 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.242623    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.325252 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.325216    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.330933 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.330682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:04.343179 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.343161    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.443714 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.443680    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.544275 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.544182    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.644562 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.644526    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.731289 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.731253    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 23:09:04.731791 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.731463    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 23:09:04.745665 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.745634    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.774894 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.774865    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:09:04.825999 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.825919    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:04:04 +0000 UTC" deadline="2028-04-14 19:26:44.03637557 +0000 UTC"
Sep 09 23:09:04.825999 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:04.825951    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13988h17m39.210428433s"
Sep 09 23:09:04.846094 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.846063    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:04.946472 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:04.946439    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-254.ec2.internal\" not found"
Sep 09 23:09:05.000637 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.000604    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:09:05.012812 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.012778    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:05.026846 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.026824    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:09:05.028079 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.028058    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal"
Sep 09 23:09:05.034435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.034418    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 23:09:05.078570 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.078549    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:09:05.251174 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.251136    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:09:05.788455 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.788423    2564 apiserver.go:52] "Watching apiserver"
Sep 09 23:09:05.793881 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.793853    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 23:09:05.794310 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.794284    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pd7r6","openshift-ovn-kubernetes/ovnkube-node-p2w7r","kube-system/global-pull-secret-syncer-qdv4k","kube-system/konnectivity-agent-jm4vm","kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal","openshift-cluster-node-tuning-operator/tuned-bjk8c","openshift-dns/node-resolver-gnmpd","openshift-image-registry/node-ca-ckxm8","openshift-multus/multus-65d9z","openshift-multus/network-metrics-daemon-kmp69","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal","openshift-multus/multus-additional-cni-plugins-nt25c","openshift-network-diagnostics/network-check-target-8nzxs"]
Sep 09 23:09:05.797117 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.797091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.799222 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.799195    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gw6zs\""
Sep 09 23:09:05.799345 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.799243    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.799345 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.799310    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.799636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.799609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.801612 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.801577    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 23:09:05.801821 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.801627    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.801821 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.801586    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.801821 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.801577    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q26wd\""
Sep 09 23:09:05.802042 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.801987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.802238 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.802078    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:05.804475 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.804453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.806723 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.806698    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 23:09:05.806874 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.806793    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xt8dw\""
Sep 09 23:09:05.806974 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.806930    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 23:09:05.807889 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.807622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:05.807889 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.807705    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:05.810138 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.810117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.812092 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.811814    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 23:09:05.812379 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.812253    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.812379 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.812303    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.812379 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.812359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j4smk\""
Sep 09 23:09:05.812606 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.812543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.815083 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.815029    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 23:09:05.815083 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.815037    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.815243 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.815132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-662pn\""
Sep 09 23:09:05.815243 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.815236    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.815361 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.815240    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 23:09:05.816022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.816003    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.819431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.819155    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 23:09:05.819431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.819273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 23:09:05.819617 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.819572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2x7h\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.819838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.822105    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.822810    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.822973    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.823143    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dm66b\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.823391    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.823504    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.823512    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 23:09:05.823746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.822218    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.824298 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.823900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:05.824298 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.824112    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:05.824747 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824598    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-conf\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.824747 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-host\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.824747 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-netns\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-socket-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.824975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-kubelet-config\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8695672-c0eb-4e6a-b551-6dac1cdd4188-agent-certs\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8695672-c0eb-4e6a-b551-6dac1cdd4188-konnectivity-ca\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-k8s-cni-cncf-io\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-bin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-hostroot\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-etc-kubernetes\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825391    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.825465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-cnibin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825498    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-multus\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-kubelet\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-multus-daemon-config\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-multus-certs\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825701    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-modprobe-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-run\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e43b611b-e005-461c-901f-6f06ecb41449-hosts-file\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825796    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2c8\" (UniqueName: \"kubernetes.io/projected/e43b611b-e005-461c-901f-6f06ecb41449-kube-api-access-ls2c8\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-socket-dir-parent\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-conf-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.825987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-cnibin\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-systemd\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826039    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43b611b-e005-461c-901f-6f06ecb41449-tmp-dir\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.826091 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6544h\" (UniqueName: \"kubernetes.io/projected/623e0992-e247-4389-bccc-8727d736cce0-kube-api-access-6544h\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-system-cni-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-sys-fs\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-dbus\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-var-lib-kubelet\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-kubernetes\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-lib-modules\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-tmp\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.826785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-cni-binary-copy\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.827314 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zppf\" (UniqueName: \"kubernetes.io/projected/2713c194-6d79-4c42-a0ed-6eac700bd135-kube-api-access-8zppf\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.827314 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826833    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-device-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.827314 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.826940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-tuned\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.827606 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-system-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.827679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.827679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.827796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-etc-selinux\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.827796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsb8f\" (UniqueName: \"kubernetes.io/projected/72a2834d-b83c-4e70-91e5-e1d3c236e962-kube-api-access-wsb8f\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.827796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827742    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.827796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827766    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysconfig\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.827796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-sys\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.828131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvj6\" (UniqueName: \"kubernetes.io/projected/2d4198ff-535d-473f-a9c1-2e00df08c18e-kube-api-access-8pvj6\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.828131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.828131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.827871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-registration-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.829169 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.829137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:05.831361 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.831137    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.831361 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.831155    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 23:09:05.831361 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.831330    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.831564 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.831403    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-56sjq\""
Sep 09 23:09:05.832379 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.832357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:05.834539 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.834513    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 23:09:05.834630 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.834582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5bjvq\""
Sep 09 23:09:05.835240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.834787    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 23:09:05.835240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.834932    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 23:09:05.848943 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.848920    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d5txd"
Sep 09 23:09:05.857152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.857124    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d5txd"
Sep 09 23:09:05.890710 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.890656    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal" event={"ID":"7a1b0e0c85c71eed0c06c4b54bd79641","Type":"ContainerStarted","Data":"f0f5a6d5f0f5c7f635f817b01dd4138a4b4a96332884b6ebfcc643245191bf10"}
Sep 09 23:09:05.892392 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.892366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal" event={"ID":"ae436a8b1f6a6aee0446437ebc6f1294","Type":"ContainerStarted","Data":"1ee228cfc719e72dda0fab7e6c86ac4626ad8afa7877ef9658ec602f6351955c"}
Sep 09 23:09:05.914445 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.914409    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 23:09:05.928189 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/468a8e34-99ef-4b22-be9f-10c541d4cc9a-host-slash\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckknt\" (UniqueName: \"kubernetes.io/projected/468a8e34-99ef-4b22-be9f-10c541d4cc9a-kube-api-access-ckknt\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-multus\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-multus-certs\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zppf\" (UniqueName: \"kubernetes.io/projected/2713c194-6d79-4c42-a0ed-6eac700bd135-kube-api-access-8zppf\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-device-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-slash\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-etc-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-node-log\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-modprobe-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-socket-dir-parent\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-sys-fs\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/468a8e34-99ef-4b22-be9f-10c541d4cc9a-iptables-alerter-script\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dm6\" (UniqueName: \"kubernetes.io/projected/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-kube-api-access-x7dm6\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-system-cni-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-dbus\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-systemd-units\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-var-lib-kubelet\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928525    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-kubernetes\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-kubelet\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-netd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-config\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-etc-selinux\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.928841 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsb8f\" (UniqueName: \"kubernetes.io/projected/72a2834d-b83c-4e70-91e5-e1d3c236e962-kube-api-access-wsb8f\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c734a93-79d9-4c96-8994-d728f489c4b3-ovn-node-metrics-cert\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-serviceca\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysconfig\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-sys\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-registration-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-netns\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-host\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-socket-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-var-lib-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-k8s-cni-cncf-io\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-etc-kubernetes\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-bin\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.928999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9f4\" (UniqueName: \"kubernetes.io/projected/5c734a93-79d9-4c96-8994-d728f489c4b3-kube-api-access-4w9f4\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-cnibin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.929737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-kubelet\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929124    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-multus-daemon-config\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-run\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929214    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e43b611b-e005-461c-901f-6f06ecb41449-hosts-file\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2c8\" (UniqueName: \"kubernetes.io/projected/e43b611b-e005-461c-901f-6f06ecb41449-kube-api-access-ls2c8\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-conf-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-cnibin\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-log-socket\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmlx\" (UniqueName: \"kubernetes.io/projected/f88d163c-60ae-4403-9752-a1fd392b9b22-kube-api-access-dnmlx\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-systemd\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43b611b-e005-461c-901f-6f06ecb41449-tmp-dir\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6544h\" (UniqueName: \"kubernetes.io/projected/623e0992-e247-4389-bccc-8727d736cce0-kube-api-access-6544h\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-script-lib\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-lib-modules\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-tmp\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.930557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-cni-binary-copy\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-tuned\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-system-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvj6\" (UniqueName: \"kubernetes.io/projected/2d4198ff-535d-473f-a9c1-2e00df08c18e-kube-api-access-8pvj6\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-env-overrides\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-conf\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-host\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-netns\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.929963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-kubelet-config\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-systemd\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8695672-c0eb-4e6a-b551-6dac1cdd4188-agent-certs\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.931365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-k8s-cni-cncf-io\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-dbus\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/257017ea-db91-4cde-a617-e6c6cd64fba8-kubelet-config\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930943    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43b611b-e005-461c-901f-6f06ecb41449-tmp-dir\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.930981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-conf\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8695672-c0eb-4e6a-b551-6dac1cdd4188-konnectivity-ca\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-systemd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-system-cni-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-bin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-etc-kubernetes\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-hostroot\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-device-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-conf-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-ovn\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-multus-certs\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-kubernetes\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-kubelet\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.931924 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-cnibin\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-sys-fs\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-var-lib-kubelet\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-sys\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-lib-modules\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-registration-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931633    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-run\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-multus-daemon-config\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b8695672-c0eb-4e6a-b551-6dac1cdd4188-konnectivity-ca\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.931997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-multus\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932079    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-hostroot\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysctl-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-sysconfig\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-cnibin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-modprobe-d\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.932694 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.932242    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.932346    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:06.432302353 +0000 UTC m=+3.040669365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-system-cni-dir\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932490    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-etc-selinux\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d4198ff-535d-473f-a9c1-2e00df08c18e-host\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-run-netns\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-socket-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-multus-socket-dir-parent\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/623e0992-e247-4389-bccc-8727d736cce0-cni-binary-copy\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/72a2834d-b83c-4e70-91e5-e1d3c236e962-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e43b611b-e005-461c-901f-6f06ecb41449-hosts-file\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/623e0992-e247-4389-bccc-8727d736cce0-host-var-lib-cni-bin\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.932735    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2713c194-6d79-4c42-a0ed-6eac700bd135-cni-binary-copy\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.933548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.933365    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2713c194-6d79-4c42-a0ed-6eac700bd135-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.936137 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.936111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-etc-tuned\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.936647 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.936585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d4198ff-535d-473f-a9c1-2e00df08c18e-tmp\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.936763 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.936723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b8695672-c0eb-4e6a-b551-6dac1cdd4188-agent-certs\") pod \"konnectivity-agent-jm4vm\" (UID: \"b8695672-c0eb-4e6a-b551-6dac1cdd4188\") " pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:05.944271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.944249    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:05.944271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.944274    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:05.944463 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.944285    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:05.944463 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:05.944397    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:06.444368297 +0000 UTC m=+3.052735303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:05.948192 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.948133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvj6\" (UniqueName: \"kubernetes.io/projected/2d4198ff-535d-473f-a9c1-2e00df08c18e-kube-api-access-8pvj6\") pod \"tuned-bjk8c\" (UID: \"2d4198ff-535d-473f-a9c1-2e00df08c18e\") " pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:05.949803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.948600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsb8f\" (UniqueName: \"kubernetes.io/projected/72a2834d-b83c-4e70-91e5-e1d3c236e962-kube-api-access-wsb8f\") pod \"aws-ebs-csi-driver-node-wqrq2\" (UID: \"72a2834d-b83c-4e70-91e5-e1d3c236e962\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:05.950756 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.950719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zppf\" (UniqueName: \"kubernetes.io/projected/2713c194-6d79-4c42-a0ed-6eac700bd135-kube-api-access-8zppf\") pod \"multus-additional-cni-plugins-nt25c\" (UID: \"2713c194-6d79-4c42-a0ed-6eac700bd135\") " pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:05.951011 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.950987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6544h\" (UniqueName: \"kubernetes.io/projected/623e0992-e247-4389-bccc-8727d736cce0-kube-api-access-6544h\") pod \"multus-65d9z\" (UID: \"623e0992-e247-4389-bccc-8727d736cce0\") " pod="openshift-multus/multus-65d9z"
Sep 09 23:09:05.951928 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:05.951887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2c8\" (UniqueName: \"kubernetes.io/projected/e43b611b-e005-461c-901f-6f06ecb41449-kube-api-access-ls2c8\") pod \"node-resolver-gnmpd\" (UID: \"e43b611b-e005-461c-901f-6f06ecb41449\") " pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:06.032580 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-env-overrides\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-systemd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-ovn\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/468a8e34-99ef-4b22-be9f-10c541d4cc9a-host-slash\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032754    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckknt\" (UniqueName: \"kubernetes.io/projected/468a8e34-99ef-4b22-be9f-10c541d4cc9a-kube-api-access-ckknt\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.032787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-slash\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-etc-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-node-log\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032864    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/468a8e34-99ef-4b22-be9f-10c541d4cc9a-iptables-alerter-script\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dm6\" (UniqueName: \"kubernetes.io/projected/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-kube-api-access-x7dm6\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.032973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/468a8e34-99ef-4b22-be9f-10c541d4cc9a-host-slash\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-ovn\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-systemd-units\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033093    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-kubelet\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-netd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-config\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c734a93-79d9-4c96-8994-d728f489c4b3-ovn-node-metrics-cert\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-serviceca\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-slash\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-netns\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-etc-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.033261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-host\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-node-log\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-var-lib-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-bin\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9f4\" (UniqueName: \"kubernetes.io/projected/5c734a93-79d9-4c96-8994-d728f489c4b3-kube-api-access-4w9f4\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033425    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-kubelet\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-log-socket\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmlx\" (UniqueName: \"kubernetes.io/projected/f88d163c-60ae-4403-9752-a1fd392b9b22-kube-api-access-dnmlx\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-script-lib\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-netd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/468a8e34-99ef-4b22-be9f-10c541d4cc9a-iptables-alerter-script\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.034084 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.033876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-netns\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-script-lib\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034260    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-ovnkube-config\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-host\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-var-lib-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-host-cni-bin\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-systemd-units\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-log-socket\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-systemd\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.034502    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c734a93-79d9-4c96-8994-d728f489c4b3-run-openvswitch\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.034567    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:06.534549442 +0000 UTC m=+3.142916448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:06.034679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.034607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c734a93-79d9-4c96-8994-d728f489c4b3-env-overrides\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.035335 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.035073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-serviceca\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.037993 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.037970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c734a93-79d9-4c96-8994-d728f489c4b3-ovn-node-metrics-cert\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.041356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.041293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckknt\" (UniqueName: \"kubernetes.io/projected/468a8e34-99ef-4b22-be9f-10c541d4cc9a-kube-api-access-ckknt\") pod \"iptables-alerter-pd7r6\" (UID: \"468a8e34-99ef-4b22-be9f-10c541d4cc9a\") " pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.041763 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.041741    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9f4\" (UniqueName: \"kubernetes.io/projected/5c734a93-79d9-4c96-8994-d728f489c4b3-kube-api-access-4w9f4\") pod \"ovnkube-node-p2w7r\" (UID: \"5c734a93-79d9-4c96-8994-d728f489c4b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.043329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.043250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dm6\" (UniqueName: \"kubernetes.io/projected/02d28d58-fbd5-4fa7-acc5-8cb5890124ba-kube-api-access-x7dm6\") pod \"node-ca-ckxm8\" (UID: \"02d28d58-fbd5-4fa7-acc5-8cb5890124ba\") " pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.043329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.043256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmlx\" (UniqueName: \"kubernetes.io/projected/f88d163c-60ae-4403-9752-a1fd392b9b22-kube-api-access-dnmlx\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:06.110500 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.110455    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gnmpd"
Sep 09 23:09:06.119662 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.119633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2"
Sep 09 23:09:06.134671 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.134644    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:06.140617 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.140591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bjk8c"
Sep 09 23:09:06.149567 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.149541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65d9z"
Sep 09 23:09:06.157908 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.157787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nt25c"
Sep 09 23:09:06.166240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.166218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:06.177100 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.177081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pd7r6"
Sep 09 23:09:06.183942 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.183924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ckxm8"
Sep 09 23:09:06.202669 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.202648    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 23:09:06.437827 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.437744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:06.438000 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.437915    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:06.438000 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.437991    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:07.437970287 +0000 UTC m=+4.046337285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:06.538850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.538798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:06.538850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.538856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.538959    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.538990    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.538997    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.539004    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.539067    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:07.539046739 +0000 UTC m=+4.147413730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:06.539133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.539089    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:07.539078581 +0000 UTC m=+4.147445569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:06.860936 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.860855    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:04:06 +0000 UTC" deadline="2028-02-27 23:08:06.092351742 +0000 UTC"
Sep 09 23:09:06.860936 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.860935    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h58m59.231424009s"
Sep 09 23:09:06.886657 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:06.886632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:06.886786 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:06.886728    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:07.171262 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.170822    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4198ff_535d_473f_a9c1_2e00df08c18e.slice/crio-fef473af1d0a00828223665f3a06da77d965276eee1fb4278618b07dfa33dac9 WatchSource:0}: Error finding container fef473af1d0a00828223665f3a06da77d965276eee1fb4278618b07dfa33dac9: Status 404 returned error can't find the container with id fef473af1d0a00828223665f3a06da77d965276eee1fb4278618b07dfa33dac9
Sep 09 23:09:07.174948 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.174923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c734a93_79d9_4c96_8994_d728f489c4b3.slice/crio-8c2f65bfa8db79f98d120ffb20f5a258b5d04111b759ded6327e5c43f98bf6b9 WatchSource:0}: Error finding container 8c2f65bfa8db79f98d120ffb20f5a258b5d04111b759ded6327e5c43f98bf6b9: Status 404 returned error can't find the container with id 8c2f65bfa8db79f98d120ffb20f5a258b5d04111b759ded6327e5c43f98bf6b9
Sep 09 23:09:07.196267 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.196235    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623e0992_e247_4389_bccc_8727d736cce0.slice/crio-2f2c1e890a686edcbfa5c55d89285e6454e981917dbad5104c3567a011763c84 WatchSource:0}: Error finding container 2f2c1e890a686edcbfa5c55d89285e6454e981917dbad5104c3567a011763c84: Status 404 returned error can't find the container with id 2f2c1e890a686edcbfa5c55d89285e6454e981917dbad5104c3567a011763c84
Sep 09 23:09:07.197074 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.197037    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d28d58_fbd5_4fa7_acc5_8cb5890124ba.slice/crio-23bc92fd0ddb5bea3d0bdf023186762d7909da8fa1ab08110ab01d6d1ba83e0a WatchSource:0}: Error finding container 23bc92fd0ddb5bea3d0bdf023186762d7909da8fa1ab08110ab01d6d1ba83e0a: Status 404 returned error can't find the container with id 23bc92fd0ddb5bea3d0bdf023186762d7909da8fa1ab08110ab01d6d1ba83e0a
Sep 09 23:09:07.198824 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.198724    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a2834d_b83c_4e70_91e5_e1d3c236e962.slice/crio-c0832ff7074e7dd910c0cef201c2e0d6526b44da61c0ec385e107b0156e1b595 WatchSource:0}: Error finding container c0832ff7074e7dd910c0cef201c2e0d6526b44da61c0ec385e107b0156e1b595: Status 404 returned error can't find the container with id c0832ff7074e7dd910c0cef201c2e0d6526b44da61c0ec385e107b0156e1b595
Sep 09 23:09:07.200069 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.199906    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod468a8e34_99ef_4b22_be9f_10c541d4cc9a.slice/crio-a822594f34bb0e2662feeff8b254c9e13bf7489d3e36692021c367ddec1d2335 WatchSource:0}: Error finding container a822594f34bb0e2662feeff8b254c9e13bf7489d3e36692021c367ddec1d2335: Status 404 returned error can't find the container with id a822594f34bb0e2662feeff8b254c9e13bf7489d3e36692021c367ddec1d2335
Sep 09 23:09:07.201112 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.200456    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2713c194_6d79_4c42_a0ed_6eac700bd135.slice/crio-b241e2994d37fea092ce4207f8f489c1fe8f54144e8b7fd2b0e75fac9bfca226 WatchSource:0}: Error finding container b241e2994d37fea092ce4207f8f489c1fe8f54144e8b7fd2b0e75fac9bfca226: Status 404 returned error can't find the container with id b241e2994d37fea092ce4207f8f489c1fe8f54144e8b7fd2b0e75fac9bfca226
Sep 09 23:09:07.201835 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.201711    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43b611b_e005_461c_901f_6f06ecb41449.slice/crio-4f597600e17db7c1694806bd69cf35c689530ebaafbcb11973b14e1e95765b5f WatchSource:0}: Error finding container 4f597600e17db7c1694806bd69cf35c689530ebaafbcb11973b14e1e95765b5f: Status 404 returned error can't find the container with id 4f597600e17db7c1694806bd69cf35c689530ebaafbcb11973b14e1e95765b5f
Sep 09 23:09:07.203850 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:07.203730    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8695672_c0eb_4e6a_b551_6dac1cdd4188.slice/crio-176f0e9dc4170773908e2df57c4d7fae09a597bfb50b4fd7aa754e5d82bde5ff WatchSource:0}: Error finding container 176f0e9dc4170773908e2df57c4d7fae09a597bfb50b4fd7aa754e5d82bde5ff: Status 404 returned error can't find the container with id 176f0e9dc4170773908e2df57c4d7fae09a597bfb50b4fd7aa754e5d82bde5ff
Sep 09 23:09:07.447399 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.447307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:07.447529 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.447468    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:07.447577 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.447543    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:09.447524884 +0000 UTC m=+6.055891872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:07.548079 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.548040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:07.548269 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.548092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:07.548269 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548213    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:07.548269 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548232    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:07.548269 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548255    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:07.548269 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548266    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:07.548526 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548281    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:09.548259909 +0000 UTC m=+6.156626925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:07.548526 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.548313    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:09.548296578 +0000 UTC m=+6.156663583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:07.861161 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.861077    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:04:06 +0000 UTC" deadline="2028-04-15 06:53:10.431402191 +0000 UTC"
Sep 09 23:09:07.861161 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.861158    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h44m2.570248984s"
Sep 09 23:09:07.889364 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.889286    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:07.889555 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.889506    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:07.890115 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.890091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:07.890233 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:07.890207    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:07.907734 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.907696    2564 generic.go:356] "Generic (PLEG): container finished" podID="ae436a8b1f6a6aee0446437ebc6f1294" containerID="a3c4eac2acc2a5d516fdba68c100016ca988f86a89cb6568b546c9e7a0120149" exitCode=0
Sep 09 23:09:07.907937 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.907806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal" event={"ID":"ae436a8b1f6a6aee0446437ebc6f1294","Type":"ContainerDied","Data":"a3c4eac2acc2a5d516fdba68c100016ca988f86a89cb6568b546c9e7a0120149"}
Sep 09 23:09:07.911288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.911253    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jm4vm" event={"ID":"b8695672-c0eb-4e6a-b551-6dac1cdd4188","Type":"ContainerStarted","Data":"176f0e9dc4170773908e2df57c4d7fae09a597bfb50b4fd7aa754e5d82bde5ff"}
Sep 09 23:09:07.913005 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.912979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gnmpd" event={"ID":"e43b611b-e005-461c-901f-6f06ecb41449","Type":"ContainerStarted","Data":"4f597600e17db7c1694806bd69cf35c689530ebaafbcb11973b14e1e95765b5f"}
Sep 09 23:09:07.931202 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.931156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerStarted","Data":"b241e2994d37fea092ce4207f8f489c1fe8f54144e8b7fd2b0e75fac9bfca226"}
Sep 09 23:09:07.935916 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.935865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pd7r6" event={"ID":"468a8e34-99ef-4b22-be9f-10c541d4cc9a","Type":"ContainerStarted","Data":"a822594f34bb0e2662feeff8b254c9e13bf7489d3e36692021c367ddec1d2335"}
Sep 09 23:09:07.940029 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.939992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ckxm8" event={"ID":"02d28d58-fbd5-4fa7-acc5-8cb5890124ba","Type":"ContainerStarted","Data":"23bc92fd0ddb5bea3d0bdf023186762d7909da8fa1ab08110ab01d6d1ba83e0a"}
Sep 09 23:09:07.943710 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.943674    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65d9z" event={"ID":"623e0992-e247-4389-bccc-8727d736cce0","Type":"ContainerStarted","Data":"2f2c1e890a686edcbfa5c55d89285e6454e981917dbad5104c3567a011763c84"}
Sep 09 23:09:07.948466 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.947709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal" event={"ID":"7a1b0e0c85c71eed0c06c4b54bd79641","Type":"ContainerStarted","Data":"3838d7511a569fe56301ea7e2719ddc63fa050728a2323017ccb367b91a3b015"}
Sep 09 23:09:07.954089 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.953991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2" event={"ID":"72a2834d-b83c-4e70-91e5-e1d3c236e962","Type":"ContainerStarted","Data":"c0832ff7074e7dd910c0cef201c2e0d6526b44da61c0ec385e107b0156e1b595"}
Sep 09 23:09:07.967598 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.967560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"8c2f65bfa8db79f98d120ffb20f5a258b5d04111b759ded6327e5c43f98bf6b9"}
Sep 09 23:09:07.972140 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.972095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-254.ec2.internal" podStartSLOduration=2.972080916 podStartE2EDuration="2.972080916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:07.970296228 +0000 UTC m=+4.578663239" watchObservedRunningTime="2026-09-09 23:09:07.972080916 +0000 UTC m=+4.580447923"
Sep 09 23:09:07.979471 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:07.979437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bjk8c" event={"ID":"2d4198ff-535d-473f-a9c1-2e00df08c18e","Type":"ContainerStarted","Data":"fef473af1d0a00828223665f3a06da77d965276eee1fb4278618b07dfa33dac9"}
Sep 09 23:09:08.887222 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:08.887121    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:08.887807 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:08.887273    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:08.991994 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:08.991959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal" event={"ID":"ae436a8b1f6a6aee0446437ebc6f1294","Type":"ContainerStarted","Data":"b588c644da2a01fca61e38006f30a7c1d40cd8686ece826431a09ebccbeb9ddd"}
Sep 09 23:09:09.465980 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:09.465934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:09.466199 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.466115    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:09.466199 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.466187    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:13.466166501 +0000 UTC m=+10.074533514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:09.566908 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:09.566863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:09.567122 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:09.566936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:09.567122 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567089    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:09.567265 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567154    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:13.567135196 +0000 UTC m=+10.175502190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:09.567641 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567621    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:09.567759 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567647    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:09.567759 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567661    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:09.567759 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.567713    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:13.567696155 +0000 UTC m=+10.176063144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:09.887328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:09.886503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:09.887328 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.886651    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:09.887328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:09.887118    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:09.887328 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:09.887223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:10.887183 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:10.887146    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:10.887340 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:10.887287    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:11.888431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:11.887977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:11.888431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:11.887977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:11.888431 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:11.888121    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:11.888431 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:11.888175    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:12.887316 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:12.886733    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:12.887316 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:12.886879    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:13.504131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:13.504095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:13.504466 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.504229    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:13.504466 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.504298    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:21.504281405 +0000 UTC m=+18.112648407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:13.604628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:13.604587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:13.604628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:13.604631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:13.604836 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604811    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:13.604918 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604848    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:13.604918 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604884    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:13.604918 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604897    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:13.604918 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604915    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:21.60489477 +0000 UTC m=+18.213261758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:13.605073 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.604964    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:21.604926239 +0000 UTC m=+18.213293228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:13.891388 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:13.888671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:13.891388 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.888826    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:13.891388 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:13.888951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:13.891388 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:13.889109    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:14.886448 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:14.886413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:14.886957 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:14.886548    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:15.887537 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:15.887315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:15.888010 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:15.887373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:15.888010 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:15.887632    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:15.888010 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:15.887722    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:16.887153 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:16.887124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:16.887318 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:16.887229    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:17.886795 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:17.886751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:17.887275 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:17.886907    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:17.887275 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:17.886949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:17.887373 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:17.887327    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:18.886836 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:18.886803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:18.887221 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:18.886936    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:19.887131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:19.887092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:19.887572 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:19.887096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:19.887572 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:19.887233    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:19.887572 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:19.887352    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:20.886954 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:20.886919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:20.887168 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:20.887045    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:21.562955 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:21.562904    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:21.563105 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.563071    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:21.563156 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.563136    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:37.563120649 +0000 UTC m=+34.171487655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:21.664061 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:21.664029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:21.664069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664197    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664220    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664242    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664256    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:21.664271 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664261    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:37.664245219 +0000 UTC m=+34.272612224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:21.664525 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.664305    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:09:37.664290028 +0000 UTC m=+34.272657017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:21.886613 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:21.886526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:21.886776 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:21.886526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:21.886776 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.886680    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:21.886776 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:21.886730    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:22.887262 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:22.887222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:22.887680 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:22.887336    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:23.887334 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:23.887298    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:23.887817 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:23.887412    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:23.887817 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:23.887422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:23.887817 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:23.887515    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:24.886474 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:24.886438    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:24.886708 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:24.886564    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:25.886638 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:25.886444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:25.887491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:25.886483    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:25.887491 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:25.886748    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:25.887491 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:25.886769    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:26.033785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"db0639dbf6e98dfb6daf3f49101202780d0cdedbd8252b8e88e4ad5e12cf14ad"}
Sep 09 23:09:26.034016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033821    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"190b114c54f2e09acdf203250fb39a483aed94e2daaff89621081094af4fa645"}
Sep 09 23:09:26.034016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"c85d1288e4d9579f1b7d46094939d29e5b900d6fc575ae45b2e8e0a0105167b5"}
Sep 09 23:09:26.034016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"63c866f261db391a1552106c125083e19a2a9cc14b6c4908d8105e49cfde959e"}
Sep 09 23:09:26.034016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"5dfc8d380ca0672577a4557f968b73f1b98669c8168925ddc11a972379110bb8"}
Sep 09 23:09:26.034016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.033984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"d98684a9427ac9246e88b7120bd2ca07b2882628df62f21df956616f6fdcd3f2"}
Sep 09 23:09:26.035177 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.035155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bjk8c" event={"ID":"2d4198ff-535d-473f-a9c1-2e00df08c18e","Type":"ContainerStarted","Data":"d23de0d9eb146afe9e91ae080f950ccec86e5c4fe9146785d448cdfebc71a35e"}
Sep 09 23:09:26.036447 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.036427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jm4vm" event={"ID":"b8695672-c0eb-4e6a-b551-6dac1cdd4188","Type":"ContainerStarted","Data":"c0456aa2f272e67c803345c6115447590d9d56643cb57aea5c4b6d561453482b"}
Sep 09 23:09:26.038017 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.037993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gnmpd" event={"ID":"e43b611b-e005-461c-901f-6f06ecb41449","Type":"ContainerStarted","Data":"7b99715b11b4365115ce922e6b0a55d400c7e9e82b32685b53519f4ca6fb6623"}
Sep 09 23:09:26.039997 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.039971    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="7cecf275b8f9e74f4480496fa0fb520af04ffd2a817724508ccd5b60bcb10e12" exitCode=0
Sep 09 23:09:26.040092 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.040060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"7cecf275b8f9e74f4480496fa0fb520af04ffd2a817724508ccd5b60bcb10e12"}
Sep 09 23:09:26.041911 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.041881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ckxm8" event={"ID":"02d28d58-fbd5-4fa7-acc5-8cb5890124ba","Type":"ContainerStarted","Data":"70e7e744547218c6fa77b0950f90f15e12c184d9325055a15cc6ea6d3535fd56"}
Sep 09 23:09:26.043853 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.043830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65d9z" event={"ID":"623e0992-e247-4389-bccc-8727d736cce0","Type":"ContainerStarted","Data":"103283bf11f569cbf89ac2c4b4662b1ca43a5401c459253552a87505a4bd7be5"}
Sep 09 23:09:26.045829 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.045812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2" event={"ID":"72a2834d-b83c-4e70-91e5-e1d3c236e962","Type":"ContainerStarted","Data":"ce6c14077e983a4ba2cc29475f3776269b19703aac7d8f39fbda16c888b1ce90"}
Sep 09 23:09:26.053556 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.053502    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-254.ec2.internal" podStartSLOduration=21.05348106 podStartE2EDuration="21.05348106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:09.009926573 +0000 UTC m=+5.618293585" watchObservedRunningTime="2026-09-09 23:09:26.05348106 +0000 UTC m=+22.661848068"
Sep 09 23:09:26.053955 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.053928    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bjk8c" podStartSLOduration=4.13955534 podStartE2EDuration="22.053920764s" totalImagesPullingTime="17.914365424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:26.053349934 +0000 UTC m=+22.661716957" watchObservedRunningTime="2026-09-09 23:09:26.053920764 +0000 UTC m=+22.662287770"
Sep 09 23:09:26.098899 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.098837    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gnmpd" podStartSLOduration=4.220425617 podStartE2EDuration="22.098823349s" totalImagesPullingTime="17.878397732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:26.09863877 +0000 UTC m=+22.707005777" watchObservedRunningTime="2026-09-09 23:09:26.098823349 +0000 UTC m=+22.707190357"
Sep 09 23:09:26.142364 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.142314    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jm4vm" podStartSLOduration=7.920979194 podStartE2EDuration="22.142298855s" totalImagesPullingTime="14.221319661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:26.124728753 +0000 UTC m=+22.733095759" watchObservedRunningTime="2026-09-09 23:09:26.142298855 +0000 UTC m=+22.750665861"
Sep 09 23:09:26.142518 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.142475    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ckxm8" podStartSLOduration=4.26735551 podStartE2EDuration="22.142471913s" totalImagesPullingTime="17.875116403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:26.141955583 +0000 UTC m=+22.750322590" watchObservedRunningTime="2026-09-09 23:09:26.142471913 +0000 UTC m=+22.750838919"
Sep 09 23:09:26.160363 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.160315    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-65d9z" podStartSLOduration=4.187001326 podStartE2EDuration="22.160300843s" totalImagesPullingTime="17.973299517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:26.159953674 +0000 UTC m=+22.768320679" watchObservedRunningTime="2026-09-09 23:09:26.160300843 +0000 UTC m=+22.768667851"
Sep 09 23:09:26.689686 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.689658    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 23:09:26.886421 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.886338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:26.886421 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.886293    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:09:26.689678531Z","UUID":"345b8abc-399c-4e6a-b5c5-99cffd9d9f02","Handler":null,"Name":"","Endpoint":""}
Sep 09 23:09:26.886654 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:26.886462    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:26.888451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.888406    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 23:09:26.888451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:26.888444    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 23:09:27.050003 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:27.049961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pd7r6" event={"ID":"468a8e34-99ef-4b22-be9f-10c541d4cc9a","Type":"ContainerStarted","Data":"f22e6d9096fc76b7dc71ad298626c5ca27732600765aa3f04a02fd7fa4391b23"}
Sep 09 23:09:27.052405 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:27.052271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2" event={"ID":"72a2834d-b83c-4e70-91e5-e1d3c236e962","Type":"ContainerStarted","Data":"2d89f53eb357a0ed55bc476e2256b75e6b002e6229769e3735bad49667ff0479"}
Sep 09 23:09:27.065934 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:27.065883    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pd7r6" podStartSLOduration=5.193181313 podStartE2EDuration="23.065848042s" totalImagesPullingTime="17.872666729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:27.065561268 +0000 UTC m=+23.673928275" watchObservedRunningTime="2026-09-09 23:09:27.065848042 +0000 UTC m=+23.674215050"
Sep 09 23:09:27.887053 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:27.886888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:27.887053 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:27.887006    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:27.887775 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:27.887618    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:27.887775 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:27.887736    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:28.057723 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:28.057627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2" event={"ID":"72a2834d-b83c-4e70-91e5-e1d3c236e962","Type":"ContainerStarted","Data":"fb5bbda42ea8fe7244bc4dc58886662146e98d42259bf23d291feeb33fcedd32"}
Sep 09 23:09:28.064255 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:28.062851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"98dcdd46d90b7e79839f6c6085fa5566aaaf9041483478994539a9ac56c7468b"}
Sep 09 23:09:28.078088 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:28.078035    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wqrq2" podStartSLOduration=3.8853356850000003 podStartE2EDuration="24.078016415s" totalImagesPullingTime="20.19268073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:28.077711707 +0000 UTC m=+24.686078714" watchObservedRunningTime="2026-09-09 23:09:28.078016415 +0000 UTC m=+24.686383459"
Sep 09 23:09:28.886995 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:28.886962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:28.887190 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:28.887075    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:29.886369 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:29.886335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:29.886537 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:29.886335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:29.886537 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:29.886470    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:29.886643 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:29.886529    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:30.156821 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:30.156733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:30.157373 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:30.157346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:30.887400 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:30.887221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:30.887610 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:30.887477    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:31.071777 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.071746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerStarted","Data":"124a201cd13c012a300f9d7b96571b5690282728db66d45e8f3e20728e4adf81"}
Sep 09 23:09:31.077562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.077530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" event={"ID":"5c734a93-79d9-4c96-8994-d728f489c4b3","Type":"ContainerStarted","Data":"0659df7a151364eab4eef6db48965d6cf9f75121a6e91d5f3f129665d0782c3b"}
Sep 09 23:09:31.077787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.077760    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:31.077883 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.077833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:31.093228 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.093209    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:31.119293 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.119254    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r" podStartSLOduration=9.189785041 podStartE2EDuration="27.119239495s" totalImagesPullingTime="17.929454454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:31.118746241 +0000 UTC m=+27.727113248" watchObservedRunningTime="2026-09-09 23:09:31.119239495 +0000 UTC m=+27.727606495"
Sep 09 23:09:31.886676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.886638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:31.886676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:31.886657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:31.887470 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:31.886791    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:31.887470 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:31.886891    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:32.082145 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.082112    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="124a201cd13c012a300f9d7b96571b5690282728db66d45e8f3e20728e4adf81" exitCode=0
Sep 09 23:09:32.082305 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.082197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"124a201cd13c012a300f9d7b96571b5690282728db66d45e8f3e20728e4adf81"}
Sep 09 23:09:32.082698 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.082621    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:32.097964 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.097935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:09:32.593926 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.593893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdv4k"]
Sep 09 23:09:32.594101 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.593996    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:32.594101 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:32.594086    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:32.597095 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.597072    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmp69"]
Sep 09 23:09:32.597220 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.597175    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:32.597290 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:32.597271    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:32.597848 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.597825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8nzxs"]
Sep 09 23:09:32.597952 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:32.597942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:32.598042 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:32.598021    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:33.887234 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:33.887044    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:33.887754 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:33.887115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:33.887754 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:33.887313    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:33.887754 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:33.887420    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:34.088708 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:34.088673    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="7c7e0f159577a6b67179903a252db87bf1772fc14b201e956c8ad2530940822a" exitCode=0
Sep 09 23:09:34.088819 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:34.088746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"7c7e0f159577a6b67179903a252db87bf1772fc14b201e956c8ad2530940822a"}
Sep 09 23:09:34.886301 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:34.886269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:34.886437 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:34.886405    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:35.667677 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:35.667636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:35.668110 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:35.667806    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 09 23:09:35.668247 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:35.668230    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jm4vm"
Sep 09 23:09:35.886756 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:35.886729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:35.886904 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:35.886729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:35.886904 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:35.886830    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:35.886990 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:35.886903    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:36.094474 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:36.094439    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="69e86f38191d87b8be3b36b26a889990071e19c04b4fb3c3495207012a1467a0" exitCode=0
Sep 09 23:09:36.094658 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:36.094498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"69e86f38191d87b8be3b36b26a889990071e19c04b4fb3c3495207012a1467a0"}
Sep 09 23:09:36.886860 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:36.886828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:36.887385 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:36.886955    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qdv4k" podUID="257017ea-db91-4cde-a617-e6c6cd64fba8"
Sep 09 23:09:37.577751 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:37.577717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:37.577966 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.577903    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:37.578035 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.577980    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret podName:257017ea-db91-4cde-a617-e6c6cd64fba8 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:09.577960009 +0000 UTC m=+66.186327004 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret") pod "global-pull-secret-syncer-qdv4k" (UID: "257017ea-db91-4cde-a617-e6c6cd64fba8") : object "kube-system"/"original-pull-secret" not registered
Sep 09 23:09:37.678902 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:37.678853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:37.678912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679014    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679026    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679046    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679058    2564 projected.go:196] Error preparing data for projected volume kube-api-access-knwz2 for pod openshift-network-diagnostics/network-check-target-8nzxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:37.679082 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679078    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:09.679063271 +0000 UTC m=+66.287430275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 23:09:37.679293 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.679105    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2 podName:e64312a5-0411-4da3-8018-68add1fd966c nodeName:}" failed. No retries permitted until 2026-09-09 23:10:09.67908905 +0000 UTC m=+66.287456052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-knwz2" (UniqueName: "kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2") pod "network-check-target-8nzxs" (UID: "e64312a5-0411-4da3-8018-68add1fd966c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 23:09:37.887390 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:37.887298    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:37.887818 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.887447    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmp69" podUID="f88d163c-60ae-4403-9752-a1fd392b9b22"
Sep 09 23:09:37.887818 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:37.887496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:37.887818 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:37.887603    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nzxs" podUID="e64312a5-0411-4da3-8018-68add1fd966c"
Sep 09 23:09:38.218833 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.218801    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-254.ec2.internal" event="NodeReady"
Sep 09 23:09:38.219020 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.218967    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 23:09:38.252438 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.252404    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:09:38.256600 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.256108    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"]
Sep 09 23:09:38.256900 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.256857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.259092 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.259071    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 23:09:38.259211 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.259072    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-97thr\""
Sep 09 23:09:38.259419 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.259403    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 23:09:38.259500 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.259438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 23:09:38.260703 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.260075    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"]
Sep 09 23:09:38.260703 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.260221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.263106 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.262944    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 23:09:38.263203 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263165    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 09 23:09:38.263454 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263433    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 09 23:09:38.263683 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263665    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"]
Sep 09 23:09:38.263775 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263714    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 23:09:38.263775 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 09 23:09:38.263897 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 23:09:38.263897 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.263885    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 09 23:09:38.264099 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.264081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.266131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.266111    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 23:09:38.267323 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.267305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 09 23:09:38.267580 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.267564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.269731 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.269710    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 09 23:09:38.269827 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.269780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mghss"]
Sep 09 23:09:38.270100 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.270083    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dc8x7\""
Sep 09 23:09:38.273221 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.273201    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"]
Sep 09 23:09:38.273860 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.273837    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:09:38.273966 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.273915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.276099 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.276079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 23:09:38.276203 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.276132    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 23:09:38.276364 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.276348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gc94v\""
Sep 09 23:09:38.276469 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.276366    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 23:09:38.279663 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.279642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bxznx"]
Sep 09 23:09:38.283233 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.283214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"]
Sep 09 23:09:38.283333 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.283250    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mghss"]
Sep 09 23:09:38.283465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.283336    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.286072 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.286056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 23:09:38.286324 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.286307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 23:09:38.286645 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.286628    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f58z\""
Sep 09 23:09:38.290232 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.290211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"]
Sep 09 23:09:38.295790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.294047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bxznx"]
Sep 09 23:09:38.385098 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhn5\" (UniqueName: \"kubernetes.io/projected/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-kube-api-access-pbhn5\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.385250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-cert\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.385250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-tmp\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.385250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.385435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaafc10a-55f9-465c-b72e-6a757910facd-tmp-dir\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.385435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af02ffb-b54e-4a91-92c7-f155a94251ee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaafc10a-55f9-465c-b72e-6a757910facd-config-volume\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqj9j\" (UniqueName: \"kubernetes.io/projected/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-kube-api-access-zqj9j\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc25t\" (UniqueName: \"kubernetes.io/projected/aaafc10a-55f9-465c-b72e-6a757910facd-kube-api-access-pc25t\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.385679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6sq\" (UniqueName: \"kubernetes.io/projected/9af02ffb-b54e-4a91-92c7-f155a94251ee-kube-api-access-6s6sq\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qhs\" (UniqueName: \"kubernetes.io/projected/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-kube-api-access-z9qhs\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjtw\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385848    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.385991 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.385884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-klusterlet-config\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.431321 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.431273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm4vm_b8695672-c0eb-4e6a-b551-6dac1cdd4188/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:38.487085 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.486980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaafc10a-55f9-465c-b72e-6a757910facd-tmp-dir\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.487240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af02ffb-b54e-4a91-92c7-f155a94251ee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.487240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.487358 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.487358 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aaafc10a-55f9-465c-b72e-6a757910facd-tmp-dir\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.487459 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.487528 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.487599 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaafc10a-55f9-465c-b72e-6a757910facd-config-volume\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.487683 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqj9j\" (UniqueName: \"kubernetes.io/projected/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-kube-api-access-zqj9j\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.487737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc25t\" (UniqueName: \"kubernetes.io/projected/aaafc10a-55f9-465c-b72e-6a757910facd-kube-api-access-pc25t\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.487791 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6sq\" (UniqueName: \"kubernetes.io/projected/9af02ffb-b54e-4a91-92c7-f155a94251ee-kube-api-access-6s6sq\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.487843 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.487843 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.487843 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487829    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af02ffb-b54e-4a91-92c7-f155a94251ee-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487840    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qhs\" (UniqueName: \"kubernetes.io/projected/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-kube-api-access-z9qhs\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjtw\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.487988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-klusterlet-config\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.488022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhn5\" (UniqueName: \"kubernetes.io/projected/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-kube-api-access-pbhn5\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-cert\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-tmp\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.488408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.488694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.488649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.488792 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.488750    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:38.488792 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.488766    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:38.488905 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.488815    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:38.988797991 +0000 UTC m=+35.597164984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:09:38.489027 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.489006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aaafc10a-55f9-465c-b72e-6a757910facd-config-volume\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.489384 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.489363    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:38.489489 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.489436    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:38.989417397 +0000 UTC m=+35.597784385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:38.489489 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.489455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-tmp\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.491431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.491272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.492727 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.492707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.492956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.492911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.494060 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.494156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-ca\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.494220 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.494427 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-klusterlet-config\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.494504 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494433    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.494504 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9af02ffb-b54e-4a91-92c7-f155a94251ee-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.494688 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.494656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-cert\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.497711 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.497645    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqj9j\" (UniqueName: \"kubernetes.io/projected/0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7-kube-api-access-zqj9j\") pod \"ingress-canary-mghss\" (UID: \"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7\") " pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.497711 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.497648    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qhs\" (UniqueName: \"kubernetes.io/projected/4c9c9adb-ca61-48bb-be52-9ec65c0d68b5-kube-api-access-z9qhs\") pod \"managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9\" (UID: \"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.497711 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.497649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6sq\" (UniqueName: \"kubernetes.io/projected/9af02ffb-b54e-4a91-92c7-f155a94251ee-kube-api-access-6s6sq\") pod \"cluster-proxy-proxy-agent-c99dbfdfb-7bjf6\" (UID: \"9af02ffb-b54e-4a91-92c7-f155a94251ee\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.498073 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.498053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc25t\" (UniqueName: \"kubernetes.io/projected/aaafc10a-55f9-465c-b72e-6a757910facd-kube-api-access-pc25t\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.498504 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.498486    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.499892 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.499847    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjtw\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.499983 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.499957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhn5\" (UniqueName: \"kubernetes.io/projected/5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc-kube-api-access-pbhn5\") pod \"klusterlet-addon-workmgr-759db786b8-7h7zc\" (UID: \"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.518993 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.518950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jm4vm_b8695672-c0eb-4e6a-b551-6dac1cdd4188/konnectivity-agent/0.log" limit=1024
Sep 09 23:09:38.586949 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.586921    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:09:38.596271 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.596247    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:38.604933 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.604908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"
Sep 09 23:09:38.616993 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.616965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mghss"
Sep 09 23:09:38.886360 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.885950    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"]
Sep 09 23:09:38.886988 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.886671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:09:38.889137 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.889115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:09:38.891711 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.891636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9"]
Sep 09 23:09:38.895294 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.895271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"]
Sep 09 23:09:38.896345 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:38.896324    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c9c9adb_ca61_48bb_be52_9ec65c0d68b5.slice/crio-e516cdc781b2caeb42b10f9f25b53ce5fe9a64f155d6a21fd3cd8330920486ec WatchSource:0}: Error finding container e516cdc781b2caeb42b10f9f25b53ce5fe9a64f155d6a21fd3cd8330920486ec: Status 404 returned error can't find the container with id e516cdc781b2caeb42b10f9f25b53ce5fe9a64f155d6a21fd3cd8330920486ec
Sep 09 23:09:38.899368 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:38.899346    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9af02ffb_b54e_4a91_92c7_f155a94251ee.slice/crio-a5b1b9c2c13bb3414d6b493139986e761fd9df9731f09a6c9927c8e010db41b6 WatchSource:0}: Error finding container a5b1b9c2c13bb3414d6b493139986e761fd9df9731f09a6c9927c8e010db41b6: Status 404 returned error can't find the container with id a5b1b9c2c13bb3414d6b493139986e761fd9df9731f09a6c9927c8e010db41b6
Sep 09 23:09:38.934734 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.934706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mghss"]
Sep 09 23:09:38.937604 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:09:38.937578    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7b4df5_c5d9_4ed6_b387_f9493cadcfc7.slice/crio-d0c8778d63d1607b727a5c937bff075f2ff9d5bcea2742c1233a04ccada8116c WatchSource:0}: Error finding container d0c8778d63d1607b727a5c937bff075f2ff9d5bcea2742c1233a04ccada8116c: Status 404 returned error can't find the container with id d0c8778d63d1607b727a5c937bff075f2ff9d5bcea2742c1233a04ccada8116c
Sep 09 23:09:38.992040 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.992010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:38.992188 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:38.992078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:38.992188 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.992164    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:38.992188 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.992180    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:38.992286 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.992206    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:38.992286 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.992234    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:39.992218741 +0000 UTC m=+36.600585727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:09:38.992286 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:38.992247    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:39.992240758 +0000 UTC m=+36.600607743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:39.103208 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.103166    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc" event={"ID":"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc","Type":"ContainerStarted","Data":"2c8eb5884e5a8dc5b74f1de57dd3ca5e3cfe2f5a445c9f98fb1b50c84c67946c"}
Sep 09 23:09:39.104478 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.104442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mghss" event={"ID":"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7","Type":"ContainerStarted","Data":"d0c8778d63d1607b727a5c937bff075f2ff9d5bcea2742c1233a04ccada8116c"}
Sep 09 23:09:39.105645 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.105616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerStarted","Data":"a5b1b9c2c13bb3414d6b493139986e761fd9df9731f09a6c9927c8e010db41b6"}
Sep 09 23:09:39.106750 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.106728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9" event={"ID":"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5","Type":"ContainerStarted","Data":"e516cdc781b2caeb42b10f9f25b53ce5fe9a64f155d6a21fd3cd8330920486ec"}
Sep 09 23:09:39.886862 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.886814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:09:39.887583 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.886814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:09:39.891330 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.890011    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:09:39.891330 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.890259    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:09:39.891330 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.890358    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92n2q\""
Sep 09 23:09:39.891330 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.890395    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:09:39.893549 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:39.892090    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2q2rs\""
Sep 09 23:09:40.000366 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:40.000326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:40.000537 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:40.000412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:40.000605 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:40.000585    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:40.000655 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:40.000608    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:40.000655 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:40.000642    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:40.000732 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:40.000672    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:42.000652321 +0000 UTC m=+38.609019347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:09:40.000790 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:40.000733    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:42.000719922 +0000 UTC m=+38.609086923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:42.016687 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:42.016648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:42.016736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:42.016826    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:42.016850    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:42.016893    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:42.016927    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:46.01690753 +0000 UTC m=+42.625274519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:09:42.017321 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:42.016946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:46.016937399 +0000 UTC m=+42.625304389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:43.126506 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:43.125302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerStarted","Data":"c92d9a2c783c88be15c0bef394df23cbe254757d7caff7d1db7b57a6bc24797f"}
Sep 09 23:09:44.129752 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:44.129711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9" event={"ID":"4c9c9adb-ca61-48bb-be52-9ec65c0d68b5","Type":"ContainerStarted","Data":"593a1e68b97019429ba0743cb53f288e01cf4118b149d9fe4bba517e24e73bff"}
Sep 09 23:09:44.133378 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:44.133351    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="c92d9a2c783c88be15c0bef394df23cbe254757d7caff7d1db7b57a6bc24797f" exitCode=0
Sep 09 23:09:44.133514 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:44.133391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"c92d9a2c783c88be15c0bef394df23cbe254757d7caff7d1db7b57a6bc24797f"}
Sep 09 23:09:44.144940 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:44.144887    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6bdd5d48-cs6s9" podStartSLOduration=15.819818178 podStartE2EDuration="20.1448531s" totalImagesPullingTime="4.325034922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:44.143774041 +0000 UTC m=+40.752141049" watchObservedRunningTime="2026-09-09 23:09:44.1448531 +0000 UTC m=+40.753220106"
Sep 09 23:09:46.050786 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:46.050740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:46.050839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:46.050909    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:46.050976    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:09:54.050960575 +0000 UTC m=+50.659327560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:46.050981    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:46.050999    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:46.051205 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:46.051039    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:54.051027305 +0000 UTC m=+50.659394324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:09:49.147747 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.147710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc" event={"ID":"5e6cf81f-dbc4-47f0-a817-8e0cdabebfdc","Type":"ContainerStarted","Data":"d693a4883f32bf04869fe19e6917686037117b9a9b2dcd85b6718150eb4570d5"}
Sep 09 23:09:49.148246 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.147811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:49.149816 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.149795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc"
Sep 09 23:09:49.151048 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.151023    2564 generic.go:356] "Generic (PLEG): container finished" podID="2713c194-6d79-4c42-a0ed-6eac700bd135" containerID="c2895c694ab1f46b6f44d7dfc888efb226d402dce1bee4e6472996acde83e948" exitCode=0
Sep 09 23:09:49.151164 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.151097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerDied","Data":"c2895c694ab1f46b6f44d7dfc888efb226d402dce1bee4e6472996acde83e948"}
Sep 09 23:09:49.152762 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.152739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mghss" event={"ID":"0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7","Type":"ContainerStarted","Data":"d5d0c2202e661287aec4944214e59bab91322c7f8b807389a66b5d2a1061f7af"}
Sep 09 23:09:49.154809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.154791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerStarted","Data":"2547487edc02b54916cfc553dabc11fa58e333ce8d0b81a010ef2970ad6b0d3a"}
Sep 09 23:09:49.154912 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.154818    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerStarted","Data":"39ae2f4716b764f2bb80374c7e5ae6e4e1830d299cf70716785ccd8fc33a31d5"}
Sep 09 23:09:49.154912 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.154830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerStarted","Data":"a1db8dfe6e2f3851577a90b87105e4eafbf1556f9c466fbebb7d0ba285a899b9"}
Sep 09 23:09:49.164360 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.164322    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-759db786b8-7h7zc" podStartSLOduration=15.398983892 podStartE2EDuration="25.164309352s" totalImagesPullingTime="9.76532546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.163288763 +0000 UTC m=+45.771655771" watchObservedRunningTime="2026-09-09 23:09:49.164309352 +0000 UTC m=+45.772676356"
Sep 09 23:09:49.214215 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.214174    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mghss" podStartSLOduration=1.9740775 podStartE2EDuration="11.214159496s" totalImagesPullingTime="9.240081996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.212912592 +0000 UTC m=+45.821279599" watchObservedRunningTime="2026-09-09 23:09:49.214159496 +0000 UTC m=+45.822526503"
Sep 09 23:09:49.230385 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:49.230344    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" podStartSLOduration=15.951897853 podStartE2EDuration="25.23032585s" totalImagesPullingTime="9.278427997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:49.229965618 +0000 UTC m=+45.838332625" watchObservedRunningTime="2026-09-09 23:09:49.23032585 +0000 UTC m=+45.838692858"
Sep 09 23:09:50.161005 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:50.160970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nt25c" event={"ID":"2713c194-6d79-4c42-a0ed-6eac700bd135","Type":"ContainerStarted","Data":"bc5ca85b3a8f1c992b632d937628dae4e951f7b01f8de1a5509aecd5147205b5"}
Sep 09 23:09:50.180472 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:50.180423    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nt25c" podStartSLOduration=14.550182989 podStartE2EDuration="46.18040707s" totalImagesPullingTime="31.630224081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:50.179744344 +0000 UTC m=+46.788111392" watchObservedRunningTime="2026-09-09 23:09:50.18040707 +0000 UTC m=+46.788774078"
Sep 09 23:09:54.111064 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:54.111023    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:09:54.111085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:54.111177    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:54.111185    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:54.111204    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:54.111229    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.111215716 +0000 UTC m=+66.719582701 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:09:54.111581 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:09:54.111254    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.111239974 +0000 UTC m=+66.719606976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:10:02.439565 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.439529    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szpql"]
Sep 09 23:10:02.462114 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.462083    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szpql"]
Sep 09 23:10:02.462263 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.462203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.464323 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.464298    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 23:10:02.464467 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.464331    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 23:10:02.464467 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.464380    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 23:10:02.464467 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.464394    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zrvp\""
Sep 09 23:10:02.464855 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.464837    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 23:10:02.473846 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.473820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351e420c-8f83-48f5-bef5-45fed469cd42-data-volume\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.473986 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.473856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg4zh\" (UniqueName: \"kubernetes.io/projected/351e420c-8f83-48f5-bef5-45fed469cd42-kube-api-access-xg4zh\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.473986 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.473962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.474073 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.473989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351e420c-8f83-48f5-bef5-45fed469cd42-crio-socket\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.474073 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.474011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575286 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575241    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575286 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351e420c-8f83-48f5-bef5-45fed469cd42-crio-socket\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:02.575390    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:02.575416    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:02.575455    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:03.075439711 +0000 UTC m=+59.683806696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:02.575492    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:03.075474475 +0000 UTC m=+59.683841481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/351e420c-8f83-48f5-bef5-45fed469cd42-crio-socket\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351e420c-8f83-48f5-bef5-45fed469cd42-data-volume\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.575562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg4zh\" (UniqueName: \"kubernetes.io/projected/351e420c-8f83-48f5-bef5-45fed469cd42-kube-api-access-xg4zh\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.576028 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.575810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/351e420c-8f83-48f5-bef5-45fed469cd42-data-volume\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:02.583923 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:02.583895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg4zh\" (UniqueName: \"kubernetes.io/projected/351e420c-8f83-48f5-bef5-45fed469cd42-kube-api-access-xg4zh\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:03.080012 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:03.079974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:03.080012 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:03.080026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:03.080226 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:03.080117    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:03.080226 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:03.080127    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:03.080226 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:03.080183    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:04.080168393 +0000 UTC m=+60.688535378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:03.080226 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:03.080196    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:04.080190404 +0000 UTC m=+60.688557389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:04.087845 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:04.087798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:04.087845 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:04.087850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:04.088367 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:04.087943    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:04.088367 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:04.087962    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:04.088367 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:04.088019    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:06.088003126 +0000 UTC m=+62.696370117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:04.088367 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:04.088042    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:06.08803439 +0000 UTC m=+62.696401376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:04.099775 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:04.099748    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2w7r"
Sep 09 23:10:04.410170 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:04.410093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gnmpd_e43b611b-e005-461c-901f-6f06ecb41449/dns-node-resolver/0.log"
Sep 09 23:10:05.412104 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:05.412077    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ckxm8_02d28d58-fbd5-4fa7-acc5-8cb5890124ba/node-ca/0.log"
Sep 09 23:10:06.102672 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:06.102615    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:06.102672 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:06.102681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:06.102933 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:06.102764    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:06.102933 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:06.102839    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.102823173 +0000 UTC m=+66.711190158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:06.102933 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:06.102767    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:06.103044 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:06.102938    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:10.102921387 +0000 UTC m=+66.711288389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:06.211182 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:06.211155    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mghss_0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7/serve-healthcheck-canary/0.log"
Sep 09 23:10:09.630719 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.630680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:10:09.633284 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.633267    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 23:10:09.643205 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.643170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/257017ea-db91-4cde-a617-e6c6cd64fba8-original-pull-secret\") pod \"global-pull-secret-syncer-qdv4k\" (UID: \"257017ea-db91-4cde-a617-e6c6cd64fba8\") " pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:10:09.731624 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.731592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:10:09.731755 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.731642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:10:09.734155 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.734137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 23:10:09.734285 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.734267    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 23:10:09.742111 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:09.742097    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 23:10:09.742164 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:09.742149    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs podName:f88d163c-60ae-4403-9752-a1fd392b9b22 nodeName:}" failed. No retries permitted until 2026-09-09 23:11:13.742135041 +0000 UTC m=+130.350502026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs") pod "network-metrics-daemon-kmp69" (UID: "f88d163c-60ae-4403-9752-a1fd392b9b22") : secret "metrics-daemon-secret" not found
Sep 09 23:10:09.743850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.743835    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 23:10:09.754662 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.754643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwz2\" (UniqueName: \"kubernetes.io/projected/e64312a5-0411-4da3-8018-68add1fd966c-kube-api-access-knwz2\") pod \"network-check-target-8nzxs\" (UID: \"e64312a5-0411-4da3-8018-68add1fd966c\") " pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:10:09.800720 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.800680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qdv4k"
Sep 09 23:10:09.904972 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.904909    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92n2q\""
Sep 09 23:10:09.912875 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:09.912841    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:10:10.068191 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.068160    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qdv4k"]
Sep 09 23:10:10.070768 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:10:10.070745    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257017ea_db91_4cde_a617_e6c6cd64fba8.slice/crio-3ffd4d23987551fbd91678a2580dec3f5b3d8b0327b9169fa4e1772fb17bc1a8 WatchSource:0}: Error finding container 3ffd4d23987551fbd91678a2580dec3f5b3d8b0327b9169fa4e1772fb17bc1a8: Status 404 returned error can't find the container with id 3ffd4d23987551fbd91678a2580dec3f5b3d8b0327b9169fa4e1772fb17bc1a8
Sep 09 23:10:10.135831 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.135797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.135838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.135858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.135908    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.135971    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.135984    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.135992    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64bd456b8b-j8zkf: secret "image-registry-tls" not found
Sep 09 23:10:10.135998 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.135969    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 23:10:10.136273 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.136034    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:18.136021132 +0000 UTC m=+74.744388118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : configmap "kube-rbac-proxy" not found
Sep 09 23:10:10.136273 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.136047    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls podName:6416e967-9a28-40a2-846c-6b5b18897299 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:42.13604079 +0000 UTC m=+98.744407775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls") pod "image-registry-64bd456b8b-j8zkf" (UID: "6416e967-9a28-40a2-846c-6b5b18897299") : secret "image-registry-tls" not found
Sep 09 23:10:10.136273 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.136058    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls podName:aaafc10a-55f9-465c-b72e-6a757910facd nodeName:}" failed. No retries permitted until 2026-09-09 23:10:42.136052014 +0000 UTC m=+98.744418999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls") pod "dns-default-bxznx" (UID: "aaafc10a-55f9-465c-b72e-6a757910facd") : secret "dns-default-metrics-tls" not found
Sep 09 23:10:10.136273 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.136032    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:10.136273 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:10.136157    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:18.136136421 +0000 UTC m=+74.744503424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:10.180217 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.180138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8nzxs"]
Sep 09 23:10:10.183134 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:10:10.183113    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64312a5_0411_4da3_8018_68add1fd966c.slice/crio-11536e65cb24112d875e1b17f4d21a2343699863dfbf6ceb577c11386fb8fc5e WatchSource:0}: Error finding container 11536e65cb24112d875e1b17f4d21a2343699863dfbf6ceb577c11386fb8fc5e: Status 404 returned error can't find the container with id 11536e65cb24112d875e1b17f4d21a2343699863dfbf6ceb577c11386fb8fc5e
Sep 09 23:10:10.223029 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.222995    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8nzxs" event={"ID":"e64312a5-0411-4da3-8018-68add1fd966c","Type":"ContainerStarted","Data":"11536e65cb24112d875e1b17f4d21a2343699863dfbf6ceb577c11386fb8fc5e"}
Sep 09 23:10:10.224069 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:10.224046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdv4k" event={"ID":"257017ea-db91-4cde-a617-e6c6cd64fba8","Type":"ContainerStarted","Data":"3ffd4d23987551fbd91678a2580dec3f5b3d8b0327b9169fa4e1772fb17bc1a8"}
Sep 09 23:10:15.242415 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:15.242383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8nzxs" event={"ID":"e64312a5-0411-4da3-8018-68add1fd966c","Type":"ContainerStarted","Data":"39f2cb9f140259024e0964fbdd7110f62b79d9107358450023491b0eb29d23be"}
Sep 09 23:10:15.242735 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:15.242516    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:10:15.256558 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:15.256517    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8nzxs" podStartSLOduration=66.347554852 podStartE2EDuration="1m11.25650241s" totalImagesPullingTime="4.908947558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:15.255960211 +0000 UTC m=+71.864327219" watchObservedRunningTime="2026-09-09 23:10:15.25650241 +0000 UTC m=+71.864869417"
Sep 09 23:10:16.246355 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:16.246316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qdv4k" event={"ID":"257017ea-db91-4cde-a617-e6c6cd64fba8","Type":"ContainerStarted","Data":"578b11f853a0bbd0a1adee3190dbd1be7cc81f49c154034b41d3d09238168d75"}
Sep 09 23:10:16.260947 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:16.260903    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qdv4k" podStartSLOduration=67.227909174 podStartE2EDuration="1m12.260889314s" totalImagesPullingTime="5.03298014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:16.260210204 +0000 UTC m=+72.868577212" watchObservedRunningTime="2026-09-09 23:10:16.260889314 +0000 UTC m=+72.869256318"
Sep 09 23:10:18.207776 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:18.207730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:18.208282 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:18.207790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:18.208282 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:18.207901    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:18.208282 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:18.207972    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls podName:351e420c-8f83-48f5-bef5-45fed469cd42 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:34.207954892 +0000 UTC m=+90.816321879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szpql" (UID: "351e420c-8f83-48f5-bef5-45fed469cd42") : secret "insights-runtime-extractor-tls" not found
Sep 09 23:10:18.208463 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:18.208417    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/351e420c-8f83-48f5-bef5-45fed469cd42-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:34.223803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:34.223684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:34.226036 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:34.226012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/351e420c-8f83-48f5-bef5-45fed469cd42-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szpql\" (UID: \"351e420c-8f83-48f5-bef5-45fed469cd42\") " pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:34.273475 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:34.273443    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zrvp\""
Sep 09 23:10:34.282224 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:34.282206    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szpql"
Sep 09 23:10:34.552138 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:34.552063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szpql"]
Sep 09 23:10:35.303250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:35.303215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szpql" event={"ID":"351e420c-8f83-48f5-bef5-45fed469cd42","Type":"ContainerStarted","Data":"a85b736796ee6c5c26be2cf3fe98091d1687e104c497f7f1e7d3820add34cc1b"}
Sep 09 23:10:35.303621 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:35.303271    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szpql" event={"ID":"351e420c-8f83-48f5-bef5-45fed469cd42","Type":"ContainerStarted","Data":"832504c3385842cd80636102dabeac21375d39ed6146f27e74d1ef91c6ac9901"}
Sep 09 23:10:36.309170 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:36.309136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szpql" event={"ID":"351e420c-8f83-48f5-bef5-45fed469cd42","Type":"ContainerStarted","Data":"eee412a8ed7c7430db920757dc5b26ea18e555a272f18a717f12d21937cf646e"}
Sep 09 23:10:37.314561 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:37.314528    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szpql" event={"ID":"351e420c-8f83-48f5-bef5-45fed469cd42","Type":"ContainerStarted","Data":"f4f07232359ea91ee0f8fb2a49590537f2fb04043976c56311612e5fe81563d1"}
Sep 09 23:10:37.337359 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:37.337163    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szpql" podStartSLOduration=32.857869672 podStartE2EDuration="35.337144239s" totalImagesPullingTime="2.479274567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:10:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:37.335543852 +0000 UTC m=+93.943910860" watchObservedRunningTime="2026-09-09 23:10:37.337144239 +0000 UTC m=+93.945511249"
Sep 09 23:10:42.191653 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.191613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:42.192067 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.191660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:10:42.193901 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.193879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aaafc10a-55f9-465c-b72e-6a757910facd-metrics-tls\") pod \"dns-default-bxznx\" (UID: \"aaafc10a-55f9-465c-b72e-6a757910facd\") " pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:42.194025 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.194006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"image-registry-64bd456b8b-j8zkf\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") " pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:10:42.224747 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.224720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f58z\""
Sep 09 23:10:42.232819 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.232796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:42.472271 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.472250    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-97thr\""
Sep 09 23:10:42.481059 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.481039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:10:42.505942 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.505914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bxznx"]
Sep 09 23:10:42.509652 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:10:42.509623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaafc10a_55f9_465c_b72e_6a757910facd.slice/crio-dbde39b93a5a348794840da47465fe0ef8f32f2dec8bb5ed81e7465c3013ee8c WatchSource:0}: Error finding container dbde39b93a5a348794840da47465fe0ef8f32f2dec8bb5ed81e7465c3013ee8c: Status 404 returned error can't find the container with id dbde39b93a5a348794840da47465fe0ef8f32f2dec8bb5ed81e7465c3013ee8c
Sep 09 23:10:42.757953 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:42.757853    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:10:42.760634 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:10:42.760605    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6416e967_9a28_40a2_846c_6b5b18897299.slice/crio-3c20701d215dbd222392ad33fb44b751b21586cae81993fc828eaa2a06f6a72b WatchSource:0}: Error finding container 3c20701d215dbd222392ad33fb44b751b21586cae81993fc828eaa2a06f6a72b: Status 404 returned error can't find the container with id 3c20701d215dbd222392ad33fb44b751b21586cae81993fc828eaa2a06f6a72b
Sep 09 23:10:43.334616 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.334579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxznx" event={"ID":"aaafc10a-55f9-465c-b72e-6a757910facd","Type":"ContainerStarted","Data":"dbde39b93a5a348794840da47465fe0ef8f32f2dec8bb5ed81e7465c3013ee8c"}
Sep 09 23:10:43.336322 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.336292    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" event={"ID":"6416e967-9a28-40a2-846c-6b5b18897299","Type":"ContainerStarted","Data":"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"}
Sep 09 23:10:43.336449 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.336340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" event={"ID":"6416e967-9a28-40a2-846c-6b5b18897299","Type":"ContainerStarted","Data":"3c20701d215dbd222392ad33fb44b751b21586cae81993fc828eaa2a06f6a72b"}
Sep 09 23:10:43.336449 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.336433    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:10:43.359575 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.359517    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" podStartSLOduration=99.359497756 podStartE2EDuration="1m39.359497756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:43.358057407 +0000 UTC m=+99.966424415" watchObservedRunningTime="2026-09-09 23:10:43.359497756 +0000 UTC m=+99.967864772"
Sep 09 23:10:43.447830 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.447792    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pmjgp"]
Sep 09 23:10:43.452908 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.452879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.457847 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.457819    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 23:10:43.457847 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.457830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 23:10:43.458124 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.457903    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 23:10:43.458124 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.457999    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 23:10:43.458272 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.458144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 23:10:43.458272 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.458146    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 23:10:43.458272 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.458260    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6cvrn\""
Sep 09 23:10:43.605304 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605304 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-root\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605304 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605515 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-sys\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605515 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-metrics-client-ca\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605515 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-textfile\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605515 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-wtmp\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605515 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.605707 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.605516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh9gr\" (UniqueName: \"kubernetes.io/projected/164f5037-cb8d-4ab0-88b5-37aa397a2413-kube-api-access-bh9gr\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706563 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-sys\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-metrics-client-ca\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-textfile\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-wtmp\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh9gr\" (UniqueName: \"kubernetes.io/projected/164f5037-cb8d-4ab0-88b5-37aa397a2413-kube-api-access-bh9gr\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.706740 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-sys\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-root\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-wtmp\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.706908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/164f5037-cb8d-4ab0-88b5-37aa397a2413-root\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:43.706968    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 23:10:43.707128 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:10:43.707035    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls podName:164f5037-cb8d-4ab0-88b5-37aa397a2413 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:44.2070149 +0000 UTC m=+100.815381892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls") pod "node-exporter-pmjgp" (UID: "164f5037-cb8d-4ab0-88b5-37aa397a2413") : secret "node-exporter-tls" not found
Sep 09 23:10:43.707451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.707150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-textfile\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.707237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.707451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.707358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/164f5037-cb8d-4ab0-88b5-37aa397a2413-metrics-client-ca\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.709415 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.709391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:43.717782 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:43.717757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh9gr\" (UniqueName: \"kubernetes.io/projected/164f5037-cb8d-4ab0-88b5-37aa397a2413-kube-api-access-bh9gr\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:44.211191 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.211157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:44.213364 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.213340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/164f5037-cb8d-4ab0-88b5-37aa397a2413-node-exporter-tls\") pod \"node-exporter-pmjgp\" (UID: \"164f5037-cb8d-4ab0-88b5-37aa397a2413\") " pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:44.342823 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.342762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxznx" event={"ID":"aaafc10a-55f9-465c-b72e-6a757910facd","Type":"ContainerStarted","Data":"4005a9843eb926c3b227c93e2b5e1f2f1af4828476cefc3e115075906621b64e"}
Sep 09 23:10:44.343228 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.342882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bxznx" event={"ID":"aaafc10a-55f9-465c-b72e-6a757910facd","Type":"ContainerStarted","Data":"5403edb00a1549b1f9ffabfb5a102714dadd343d47bdbbdb10ef76d25311aa43"}
Sep 09 23:10:44.343228 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.342923    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:44.364930 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.364902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmjgp"
Sep 09 23:10:44.365930 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:44.365859    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bxznx" podStartSLOduration=64.721603609 podStartE2EDuration="1m6.365845097s" totalImagesPullingTime="1.644241488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:44.365135113 +0000 UTC m=+100.973502121" watchObservedRunningTime="2026-09-09 23:10:44.365845097 +0000 UTC m=+100.974212104"
Sep 09 23:10:44.375662 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:10:44.375635    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164f5037_cb8d_4ab0_88b5_37aa397a2413.slice/crio-c2749eebaac3701d2edf273de86ad2c4eba0b43b5ffa018efdffdb8839fe7388 WatchSource:0}: Error finding container c2749eebaac3701d2edf273de86ad2c4eba0b43b5ffa018efdffdb8839fe7388: Status 404 returned error can't find the container with id c2749eebaac3701d2edf273de86ad2c4eba0b43b5ffa018efdffdb8839fe7388
Sep 09 23:10:45.348773 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:45.348737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmjgp" event={"ID":"164f5037-cb8d-4ab0-88b5-37aa397a2413","Type":"ContainerStarted","Data":"c2749eebaac3701d2edf273de86ad2c4eba0b43b5ffa018efdffdb8839fe7388"}
Sep 09 23:10:46.248785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:46.248754    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8nzxs"
Sep 09 23:10:46.353921 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:46.353884    2564 generic.go:356] "Generic (PLEG): container finished" podID="164f5037-cb8d-4ab0-88b5-37aa397a2413" containerID="43075481b16190575a2d082c9844d8ee5b3f543dc50eb0f56c048310e6ea122c" exitCode=0
Sep 09 23:10:46.354347 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:46.353958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmjgp" event={"ID":"164f5037-cb8d-4ab0-88b5-37aa397a2413","Type":"ContainerDied","Data":"43075481b16190575a2d082c9844d8ee5b3f543dc50eb0f56c048310e6ea122c"}
Sep 09 23:10:47.359235 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:47.359198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmjgp" event={"ID":"164f5037-cb8d-4ab0-88b5-37aa397a2413","Type":"ContainerStarted","Data":"d40abd0a0d94760a55afea95ff99943fe6126f12ac92cc48e021166662a8706c"}
Sep 09 23:10:47.359624 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:47.359264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmjgp" event={"ID":"164f5037-cb8d-4ab0-88b5-37aa397a2413","Type":"ContainerStarted","Data":"cdaad45649b555acbee65d497f9c8d2315117cf4b224ae91adc480bbcb28da95"}
Sep 09 23:10:47.398117 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:47.395194    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pmjgp" podStartSLOduration=2.858582134 podStartE2EDuration="4.395172085s" totalImagesPullingTime="1.457264312s" totalInitContainerRuntime="79.325639ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:10:47.392229492 +0000 UTC m=+104.000596500" watchObservedRunningTime="2026-09-09 23:10:47.395172085 +0000 UTC m=+104.003539094"
Sep 09 23:10:48.585517 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:48.585486    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:10:54.351143 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:54.351112    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bxznx"
Sep 09 23:10:58.588463 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:58.588411    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" podUID="9af02ffb-b54e-4a91-92c7-f155a94251ee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:10:58.592121 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:10:58.592098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:11:08.589190 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:08.589147    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" podUID="9af02ffb-b54e-4a91-92c7-f155a94251ee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:11:13.604805 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.604745    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" podUID="6416e967-9a28-40a2-846c-6b5b18897299" containerName="registry" containerID="cri-o://777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f" gracePeriod=30
Sep 09 23:11:13.824712 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.824677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:11:13.827022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.827002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f88d163c-60ae-4403-9752-a1fd392b9b22-metrics-certs\") pod \"network-metrics-daemon-kmp69\" (UID: \"f88d163c-60ae-4403-9752-a1fd392b9b22\") " pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:11:13.843522 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.843499    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:11:13.925097 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925010    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925097 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925047    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925097 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925081    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qjtw\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925128    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925149    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted\") pod \"6416e967-9a28-40a2-846c-6b5b18897299\" (UID: \"6416e967-9a28-40a2-846c-6b5b18897299\") "
Sep 09 23:11:13.925685 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:11:13.925760 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.925665    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:11:13.927667 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.927592    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:11:13.927667 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.927592    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw" (OuterVolumeSpecName: "kube-api-access-9qjtw") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "kube-api-access-9qjtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:11:13.927836 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.927718    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:11:13.927836 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.927758    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:11:13.928007 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.927980    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:11:13.933809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:13.933784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6416e967-9a28-40a2-846c-6b5b18897299" (UID: "6416e967-9a28-40a2-846c-6b5b18897299"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:11:14.025783 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025746    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-image-registry-private-configuration\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025804    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-bound-sa-token\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025815    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-registry-tls\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025823    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qjtw\" (UniqueName: \"kubernetes.io/projected/6416e967-9a28-40a2-846c-6b5b18897299-kube-api-access-9qjtw\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025831    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6416e967-9a28-40a2-846c-6b5b18897299-installation-pull-secrets\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025842    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-trusted-ca\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025851    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6416e967-9a28-40a2-846c-6b5b18897299-registry-certificates\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.025909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.025859    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6416e967-9a28-40a2-846c-6b5b18897299-ca-trust-extracted\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:11:14.112429 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.112400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2q2rs\""
Sep 09 23:11:14.120454 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.120430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmp69"
Sep 09 23:11:14.419131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.419097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmp69"]
Sep 09 23:11:14.423941 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:11:14.423914    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88d163c_60ae_4403_9752_a1fd392b9b22.slice/crio-fd0798ee4f59f07a5b9bb23349c0880b8a3e9ed040733e3bee2caea835a2f4ea WatchSource:0}: Error finding container fd0798ee4f59f07a5b9bb23349c0880b8a3e9ed040733e3bee2caea835a2f4ea: Status 404 returned error can't find the container with id fd0798ee4f59f07a5b9bb23349c0880b8a3e9ed040733e3bee2caea835a2f4ea
Sep 09 23:11:14.443855 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.443828    2564 generic.go:356] "Generic (PLEG): container finished" podID="6416e967-9a28-40a2-846c-6b5b18897299" containerID="777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f" exitCode=0
Sep 09 23:11:14.444020 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.443893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" event={"ID":"6416e967-9a28-40a2-846c-6b5b18897299","Type":"ContainerDied","Data":"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"}
Sep 09 23:11:14.444020 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.443945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf" event={"ID":"6416e967-9a28-40a2-846c-6b5b18897299","Type":"ContainerDied","Data":"3c20701d215dbd222392ad33fb44b751b21586cae81993fc828eaa2a06f6a72b"}
Sep 09 23:11:14.444020 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.443906    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64bd456b8b-j8zkf"
Sep 09 23:11:14.444560 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.444533    2564 scope.go:117] "RemoveContainer" containerID="777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"
Sep 09 23:11:14.445192 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.445170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmp69" event={"ID":"f88d163c-60ae-4403-9752-a1fd392b9b22","Type":"ContainerStarted","Data":"fd0798ee4f59f07a5b9bb23349c0880b8a3e9ed040733e3bee2caea835a2f4ea"}
Sep 09 23:11:14.452839 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.452820    2564 scope.go:117] "RemoveContainer" containerID="777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"
Sep 09 23:11:14.453147 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:11:14.453124    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f\": container with ID starting with 777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f not found: ID does not exist" containerID="777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"
Sep 09 23:11:14.453213 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.453155    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f"} err="failed to get container status \"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f\": rpc error: code = NotFound desc = could not find container \"777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f\": container with ID starting with 777e1d6de3cff993288cb9b732768b0926983792895b8d2637e5a565a0a01d7f not found: ID does not exist"
Sep 09 23:11:14.476329 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.476300    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:11:14.487855 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:14.487832    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64bd456b8b-j8zkf"]
Sep 09 23:11:15.890693 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:15.890660    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6416e967-9a28-40a2-846c-6b5b18897299" path="/var/lib/kubelet/pods/6416e967-9a28-40a2-846c-6b5b18897299/volumes"
Sep 09 23:11:16.454243 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:16.454207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmp69" event={"ID":"f88d163c-60ae-4403-9752-a1fd392b9b22","Type":"ContainerStarted","Data":"633101d424d75516b477483f21f5796b1a856c557a5c37622959fd7c9832844f"}
Sep 09 23:11:16.454418 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:16.454261    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmp69" event={"ID":"f88d163c-60ae-4403-9752-a1fd392b9b22","Type":"ContainerStarted","Data":"b2a86415e4fa1957a2435f3a885cc47c2dcde961e0d824a994a0238640999e51"}
Sep 09 23:11:16.470889 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:16.470828    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kmp69" podStartSLOduration=131.520949262 podStartE2EDuration="2m12.470809952s" totalImagesPullingTime="949.86069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:11:16.469235164 +0000 UTC m=+133.077602171" watchObservedRunningTime="2026-09-09 23:11:16.470809952 +0000 UTC m=+133.079176960"
Sep 09 23:11:18.588564 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:18.588522    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" podUID="9af02ffb-b54e-4a91-92c7-f155a94251ee" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 09 23:11:18.588939 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:18.588603    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6"
Sep 09 23:11:18.589097 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:18.589079    2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"2547487edc02b54916cfc553dabc11fa58e333ce8d0b81a010ef2970ad6b0d3a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 09 23:11:18.589139 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:18.589117    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" podUID="9af02ffb-b54e-4a91-92c7-f155a94251ee" containerName="service-proxy" containerID="cri-o://2547487edc02b54916cfc553dabc11fa58e333ce8d0b81a010ef2970ad6b0d3a" gracePeriod=30
Sep 09 23:11:19.467369 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:19.467339    2564 generic.go:356] "Generic (PLEG): container finished" podID="9af02ffb-b54e-4a91-92c7-f155a94251ee" containerID="2547487edc02b54916cfc553dabc11fa58e333ce8d0b81a010ef2970ad6b0d3a" exitCode=2
Sep 09 23:11:19.467517 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:19.467389    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerDied","Data":"2547487edc02b54916cfc553dabc11fa58e333ce8d0b81a010ef2970ad6b0d3a"}
Sep 09 23:11:19.467517 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:11:19.467422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c99dbfdfb-7bjf6" event={"ID":"9af02ffb-b54e-4a91-92c7-f155a94251ee","Type":"ContainerStarted","Data":"965f88641706250467a2700bfcf3ad82f5cae74ec2fbe6bd706a97a825063348"}
Sep 09 23:13:14.750694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.750660    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"]
Sep 09 23:13:14.751180 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.750894    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6416e967-9a28-40a2-846c-6b5b18897299" containerName="registry"
Sep 09 23:13:14.751180 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.750906    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6416e967-9a28-40a2-846c-6b5b18897299" containerName="registry"
Sep 09 23:13:14.751180 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.750945    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6416e967-9a28-40a2-846c-6b5b18897299" containerName="registry"
Sep 09 23:13:14.753517 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.753502    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.755461 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.755441    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 23:13:14.755589 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.755499    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ndbkd\""
Sep 09 23:13:14.755589 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.755522    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 23:13:14.762313 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.762293    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"]
Sep 09 23:13:14.844504 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.844478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.844647 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.844518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8wg\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-kube-api-access-zb8wg\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.945658 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.945629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.945774 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.945664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8wg\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-kube-api-access-zb8wg\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.953443 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.953413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:14.953742 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:14.953725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8wg\" (UniqueName: \"kubernetes.io/projected/6af6866f-814a-467a-af08-50c116568695-kube-api-access-zb8wg\") pod \"cert-manager-cainjector-559cdd8c87-tqvdz\" (UID: \"6af6866f-814a-467a-af08-50c116568695\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:15.062229 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:15.062130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"
Sep 09 23:13:15.327223 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:15.327131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz"]
Sep 09 23:13:15.330712 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:13:15.330680    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af6866f_814a_467a_af08_50c116568695.slice/crio-c1b17e6f3b63da213a670e82d2770b847502aeb06e4171a0e4625e35e2bde3a8 WatchSource:0}: Error finding container c1b17e6f3b63da213a670e82d2770b847502aeb06e4171a0e4625e35e2bde3a8: Status 404 returned error can't find the container with id c1b17e6f3b63da213a670e82d2770b847502aeb06e4171a0e4625e35e2bde3a8
Sep 09 23:13:15.836250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:15.836203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz" event={"ID":"6af6866f-814a-467a-af08-50c116568695","Type":"ContainerStarted","Data":"c1b17e6f3b63da213a670e82d2770b847502aeb06e4171a0e4625e35e2bde3a8"}
Sep 09 23:13:18.850628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:18.850531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz" event={"ID":"6af6866f-814a-467a-af08-50c116568695","Type":"ContainerStarted","Data":"ebd2217d6ada1fd32c33e9ac531f42b8bb728f13498da779499c1d66299e68e7"}
Sep 09 23:13:18.867050 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:18.866997    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tqvdz" podStartSLOduration=1.711480616 podStartE2EDuration="4.866976442s" totalImagesPullingTime="3.155495826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:18.866372632 +0000 UTC m=+255.474739649" watchObservedRunningTime="2026-09-09 23:13:18.866976442 +0000 UTC m=+255.475343451"
Sep 09 23:13:42.681022 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.680973    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"]
Sep 09 23:13:42.684177 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.684158    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.686452 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.686429    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 23:13:42.686589 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.686467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 23:13:42.686589 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.686545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 23:13:42.686801 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.686786    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 23:13:42.686985 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.686971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l5dkq\""
Sep 09 23:13:42.706984 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.706962    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"]
Sep 09 23:13:42.741794 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.741769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvvk\" (UniqueName: \"kubernetes.io/projected/66c4ab31-1340-4305-98ba-d9d87a012f39-kube-api-access-2cvvk\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.741956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.741810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.741956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.741851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.741956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.741903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.742098 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.741973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.842604 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.842562    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.842811 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.842620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvvk\" (UniqueName: \"kubernetes.io/projected/66c4ab31-1340-4305-98ba-d9d87a012f39-kube-api-access-2cvvk\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.842811 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.842648    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.842811 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.842685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.842811 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.842717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.843132 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.843090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-manifests\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.845206 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.845180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66c4ab31-1340-4305-98ba-d9d87a012f39-tmp\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.845310 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.845257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.845310 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.845299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/66c4ab31-1340-4305-98ba-d9d87a012f39-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.854987 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.854963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvvk\" (UniqueName: \"kubernetes.io/projected/66c4ab31-1340-4305-98ba-d9d87a012f39-kube-api-access-2cvvk\") pod \"opendatahub-operator-controller-manager-8494d7ccb4-9f5vq\" (UID: \"66c4ab31-1340-4305-98ba-d9d87a012f39\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:42.993692 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:42.993663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:43.273658 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:43.273580    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"]
Sep 09 23:13:43.276726 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:13:43.276700    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c4ab31_1340_4305_98ba_d9d87a012f39.slice/crio-e650d91a4b847597dacf7690a6a32bfdcb7964f4383c714997e58976c1b9454a WatchSource:0}: Error finding container e650d91a4b847597dacf7690a6a32bfdcb7964f4383c714997e58976c1b9454a: Status 404 returned error can't find the container with id e650d91a4b847597dacf7690a6a32bfdcb7964f4383c714997e58976c1b9454a
Sep 09 23:13:43.929505 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:43.929452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq" event={"ID":"66c4ab31-1340-4305-98ba-d9d87a012f39","Type":"ContainerStarted","Data":"e650d91a4b847597dacf7690a6a32bfdcb7964f4383c714997e58976c1b9454a"}
Sep 09 23:13:46.940473 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:46.940432    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq" event={"ID":"66c4ab31-1340-4305-98ba-d9d87a012f39","Type":"ContainerStarted","Data":"74e704c21a883e9a3678797633197102fc302f9fc0e491ef8fd0be1a314a7dd5"}
Sep 09 23:13:47.945428 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:47.945392    2564 generic.go:356] "Generic (PLEG): container finished" podID="66c4ab31-1340-4305-98ba-d9d87a012f39" containerID="74e704c21a883e9a3678797633197102fc302f9fc0e491ef8fd0be1a314a7dd5" exitCode=0
Sep 09 23:13:47.945810 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:47.945437    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq" event={"ID":"66c4ab31-1340-4305-98ba-d9d87a012f39","Type":"ContainerDied","Data":"74e704c21a883e9a3678797633197102fc302f9fc0e491ef8fd0be1a314a7dd5"}
Sep 09 23:13:48.951055 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:48.951015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq" event={"ID":"66c4ab31-1340-4305-98ba-d9d87a012f39","Type":"ContainerStarted","Data":"8b23da719decc1d87af676dda52d10027f8abb12bad5317f3e87e4e97ef565ff"}
Sep 09 23:13:48.951434 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:48.951135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:13:48.971435 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:48.971385    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq" podStartSLOduration=2.721214523 podStartE2EDuration="6.971365375s" totalImagesPullingTime="3.213927312s" totalInitContainerRuntime="1.03622354s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:48.969858874 +0000 UTC m=+285.578225916" watchObservedRunningTime="2026-09-09 23:13:48.971365375 +0000 UTC m=+285.579732383"
Sep 09 23:13:59.956425 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:13:59.956393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d7ccb4-9f5vq"
Sep 09 23:14:03.828419 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:03.828381    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 23:14:04.635480 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.635444    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"]
Sep 09 23:14:04.638510 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.638493    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.640719 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.640697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 09 23:14:04.640846 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.640697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j4kzv\""
Sep 09 23:14:04.640846 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.640697    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 09 23:14:04.641341 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.641325    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 23:14:04.641425 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.641390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 23:14:04.651934 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.651914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"]
Sep 09 23:14:04.694789 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.694758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.694947 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.694811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44619ef0-2867-4422-921b-c1742707cfe6-tmp\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.694947 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.694888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvx28\" (UniqueName: \"kubernetes.io/projected/44619ef0-2867-4422-921b-c1742707cfe6-kube-api-access-nvx28\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.795886 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.795835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44619ef0-2867-4422-921b-c1742707cfe6-tmp\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.796024 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.795900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvx28\" (UniqueName: \"kubernetes.io/projected/44619ef0-2867-4422-921b-c1742707cfe6-kube-api-access-nvx28\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.796024 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.795929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.796024 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:14:04.796008    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 09 23:14:04.796146 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:14:04.796060    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs podName:44619ef0-2867-4422-921b-c1742707cfe6 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:05.296044885 +0000 UTC m=+301.904411869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs") pod "kube-auth-proxy-799c6f7f87-8d7rd" (UID: "44619ef0-2867-4422-921b-c1742707cfe6") : secret "kube-auth-proxy-tls" not found
Sep 09 23:14:04.797992 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.797964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44619ef0-2867-4422-921b-c1742707cfe6-tmp\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:04.804469 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:04.804451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvx28\" (UniqueName: \"kubernetes.io/projected/44619ef0-2867-4422-921b-c1742707cfe6-kube-api-access-nvx28\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:05.298356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.298319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:05.301038 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.301017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44619ef0-2867-4422-921b-c1742707cfe6-tls-certs\") pod \"kube-auth-proxy-799c6f7f87-8d7rd\" (UID: \"44619ef0-2867-4422-921b-c1742707cfe6\") " pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:05.548215 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.548176    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"
Sep 09 23:14:05.775450 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.775419    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:05.778571 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.778555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.780722 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.780695    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 23:14:05.780850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.780698    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 23:14:05.780850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.780772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8ml46\""
Sep 09 23:14:05.780975 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.780957    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 23:14:05.781027 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.781011    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 23:14:05.791217 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.791196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:05.818318 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.818234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd"]
Sep 09 23:14:05.823218 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:14:05.823194    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44619ef0_2867_4422_921b_c1742707cfe6.slice/crio-2809fc8411729fbf5dd8535284b46cf9ca7b04bd9b86de88eb72a2303da3b6fe WatchSource:0}: Error finding container 2809fc8411729fbf5dd8535284b46cf9ca7b04bd9b86de88eb72a2303da3b6fe: Status 404 returned error can't find the container with id 2809fc8411729fbf5dd8535284b46cf9ca7b04bd9b86de88eb72a2303da3b6fe
Sep 09 23:14:05.825701 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.825686    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:14:05.904039 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6mq7\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904175    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:05.904340 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:05.904192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004493 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004668 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004668 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004659    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6mq7\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004741    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.004964 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.004912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.005485 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.005222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.007205 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.007184    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.007309 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.007238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.007309 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.007283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.007309 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.007284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.008731 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.008708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd" event={"ID":"44619ef0-2867-4422-921b-c1742707cfe6","Type":"ContainerStarted","Data":"2809fc8411729fbf5dd8535284b46cf9ca7b04bd9b86de88eb72a2303da3b6fe"}
Sep 09 23:14:06.012450 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.012427    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6mq7\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.012655 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.012635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-gbj6n\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.088008 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.087918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:06.364837 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:06.364738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:06.368075 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:14:06.368046    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12830f89_9f6d_4ff3_a7fe_e0ecb3a8c8ce.slice/crio-364044d3984ffb6cd2cbe12a7d307133d05611b2a045a738161b0ff30d49aff3 WatchSource:0}: Error finding container 364044d3984ffb6cd2cbe12a7d307133d05611b2a045a738161b0ff30d49aff3: Status 404 returned error can't find the container with id 364044d3984ffb6cd2cbe12a7d307133d05611b2a045a738161b0ff30d49aff3
Sep 09 23:14:07.016009 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:07.015966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" event={"ID":"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce","Type":"ContainerStarted","Data":"364044d3984ffb6cd2cbe12a7d307133d05611b2a045a738161b0ff30d49aff3"}
Sep 09 23:14:09.587647 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:09.587604    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:14:09.587945 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:09.587688    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 23:14:10.029901 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.029851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" event={"ID":"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce","Type":"ContainerStarted","Data":"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"}
Sep 09 23:14:10.030096 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.030069    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:10.031472 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.031444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd" event={"ID":"44619ef0-2867-4422-921b-c1742707cfe6","Type":"ContainerStarted","Data":"f33e314af42cd927c39ce7a3a5cad8cfe2e89d60284019fe94c456a6012a957f"}
Sep 09 23:14:10.031956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.031929    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-gbj6n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 23:14:10.032041 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.031985    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:14:10.048637 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.048592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" podStartSLOduration=1.831998809 podStartE2EDuration="5.048577755s" totalImagesPullingTime="3.216578946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:10.047325593 +0000 UTC m=+306.655692620" watchObservedRunningTime="2026-09-09 23:14:10.048577755 +0000 UTC m=+306.656944761"
Sep 09 23:14:10.062146 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:10.062103    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-799c6f7f87-8d7rd" podStartSLOduration=2.345220481 podStartE2EDuration="6.062091284s" totalImagesPullingTime="3.716870803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:10.061424627 +0000 UTC m=+306.669791705" watchObservedRunningTime="2026-09-09 23:14:10.062091284 +0000 UTC m=+306.670458290"
Sep 09 23:14:11.035883 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:11.035836    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-gbj6n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 23:14:11.036255 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:11.035920    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 23:14:14.036583 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:14.036549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:22.412413 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.412374    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"]
Sep 09 23:14:22.421536 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.421512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:22.425818 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.425785    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 23:14:22.426051 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.426036    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5z4ln\""
Sep 09 23:14:22.429654 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.429631    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"]
Sep 09 23:14:22.534465 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.534425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:22.534650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.534475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpclt\" (UniqueName: \"kubernetes.io/projected/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-kube-api-access-mpclt\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:22.635468 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.635427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpclt\" (UniqueName: \"kubernetes.io/projected/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-kube-api-access-mpclt\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:22.635640 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.635511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:22.635640 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:14:22.635596    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 09 23:14:22.635733 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:14:22.635661    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert podName:bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:23.135644053 +0000 UTC m=+319.744011038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert") pod "llmisvc-controller-manager-777c6bd7d5-lxf7z" (UID: "bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4") : secret "llmisvc-webhook-server-cert" not found
Sep 09 23:14:22.650053 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:22.650027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpclt\" (UniqueName: \"kubernetes.io/projected/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-kube-api-access-mpclt\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:23.140802 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:23.140755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:23.143222 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:23.143198    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lxf7z\" (UID: \"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:23.331935 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:23.331895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:23.615537 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:23.615508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"]
Sep 09 23:14:23.618678 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:14:23.618654    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbc1116c4_b2b0_4fae_a0dd_bfde6ce6caa4.slice/crio-1a4cbe1ae475e04b841a52259be91b0e5514d49f30589e1270809bc132d3f480 WatchSource:0}: Error finding container 1a4cbe1ae475e04b841a52259be91b0e5514d49f30589e1270809bc132d3f480: Status 404 returned error can't find the container with id 1a4cbe1ae475e04b841a52259be91b0e5514d49f30589e1270809bc132d3f480
Sep 09 23:14:24.084789 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:24.084755    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z" event={"ID":"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4","Type":"ContainerStarted","Data":"1a4cbe1ae475e04b841a52259be91b0e5514d49f30589e1270809bc132d3f480"}
Sep 09 23:14:26.094168 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:26.094071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z" event={"ID":"bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4","Type":"ContainerStarted","Data":"8ce7f59767f20f5d744dcb1747774e50e1957b5f215f3f2805e8e631b2b885e7"}
Sep 09 23:14:26.094514 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:26.094174    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:14:26.111088 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:26.111041    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z" podStartSLOduration=1.916929404 podStartE2EDuration="4.111024868s" totalImagesPullingTime="2.194095464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:26.10989031 +0000 UTC m=+322.718257317" watchObservedRunningTime="2026-09-09 23:14:26.111024868 +0000 UTC m=+322.719391875"
Sep 09 23:14:35.769079 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:35.769043    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:35.769452 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:35.769268    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery" containerID="cri-o://38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f" gracePeriod=30
Sep 09 23:14:36.005700 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.005673    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:36.131292 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.131202    2564 generic.go:356] "Generic (PLEG): container finished" podID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerID="38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f" exitCode=0
Sep 09 23:14:36.131292 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.131241    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"
Sep 09 23:14:36.131292 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.131284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" event={"ID":"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce","Type":"ContainerDied","Data":"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"}
Sep 09 23:14:36.131510 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.131335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n" event={"ID":"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce","Type":"ContainerDied","Data":"364044d3984ffb6cd2cbe12a7d307133d05611b2a045a738161b0ff30d49aff3"}
Sep 09 23:14:36.131510 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.131361    2564 scope.go:117] "RemoveContainer" containerID="38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"
Sep 09 23:14:36.139033 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139016    2564 scope.go:117] "RemoveContainer" containerID="38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"
Sep 09 23:14:36.139179 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139159    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139227 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139280 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139315 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139291    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6mq7\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139315 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139309    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139405 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139333    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139405 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:14:36.139359    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f\": container with ID starting with 38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f not found: ID does not exist" containerID="38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"
Sep 09 23:14:36.139405 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token\") pod \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\" (UID: \"12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce\") "
Sep 09 23:14:36.139405 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139392    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f"} err="failed to get container status \"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f\": rpc error: code = NotFound desc = could not find container \"38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f\": container with ID starting with 38e8c029cb37787a5e32db7b2cd3f17be175f1d979a0ad15386bfd329740667f not found: ID does not exist"
Sep 09 23:14:36.139611 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.139530    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:14:36.141580 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141545    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7" (OuterVolumeSpecName: "kube-api-access-t6mq7") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "kube-api-access-t6mq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:14:36.141705 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:14:36.141858 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141833    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts" (OuterVolumeSpecName: "cacerts") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:14:36.141990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141851    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:14:36.141990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141951    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:14:36.141990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.141954    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs" (OuterVolumeSpecName: "local-certs") pod "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" (UID: "12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:14:36.240118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240073    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-dns-cert\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240111    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6mq7\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-kube-api-access-t6mq7\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240122    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-local-certs\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240131    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-cacerts\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240139    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-token\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240149    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-csr-ca-configmap\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.240410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.240157    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce-istio-kubeconfig\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:14:36.451612 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.451581    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:36.457244 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:36.457216    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gbj6n"]
Sep 09 23:14:37.891082 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:37.891047    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" path="/var/lib/kubelet/pods/12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce/volumes"
Sep 09 23:14:57.100599 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:14:57.100520    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lxf7z"
Sep 09 23:15:30.424336 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.424292    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ft798"]
Sep 09 23:15:30.424803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.424539    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery"
Sep 09 23:15:30.424803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.424550    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery"
Sep 09 23:15:30.424803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.424593    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="12830f89-9f6d-4ff3-a7fe-e0ecb3a8c8ce" containerName="discovery"
Sep 09 23:15:30.427323 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.427307    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:30.429983 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.429964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 23:15:30.430102 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.429964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gsrhh\""
Sep 09 23:15:30.430384 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.430369    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 23:15:30.438388 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.438368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ft798"]
Sep 09 23:15:30.526807 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.526764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrsz8\" (UniqueName: \"kubernetes.io/projected/cb6cdec6-48d6-43fb-820d-a526aa844e01-kube-api-access-xrsz8\") pod \"authorino-operator-76b478bd78-ft798\" (UID: \"cb6cdec6-48d6-43fb-820d-a526aa844e01\") " pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:30.627964 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.627928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrsz8\" (UniqueName: \"kubernetes.io/projected/cb6cdec6-48d6-43fb-820d-a526aa844e01-kube-api-access-xrsz8\") pod \"authorino-operator-76b478bd78-ft798\" (UID: \"cb6cdec6-48d6-43fb-820d-a526aa844e01\") " pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:30.635293 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.635271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrsz8\" (UniqueName: \"kubernetes.io/projected/cb6cdec6-48d6-43fb-820d-a526aa844e01-kube-api-access-xrsz8\") pod \"authorino-operator-76b478bd78-ft798\" (UID: \"cb6cdec6-48d6-43fb-820d-a526aa844e01\") " pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:30.737268 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:30.737230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:31.014858 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:31.014765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-ft798"]
Sep 09 23:15:31.019226 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:31.019195    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6cdec6_48d6_43fb_820d_a526aa844e01.slice/crio-23b932cb7a5fae0bc4d5299bafb41d7088c1f7d66c80341ec436c14841211b70 WatchSource:0}: Error finding container 23b932cb7a5fae0bc4d5299bafb41d7088c1f7d66c80341ec436c14841211b70: Status 404 returned error can't find the container with id 23b932cb7a5fae0bc4d5299bafb41d7088c1f7d66c80341ec436c14841211b70
Sep 09 23:15:31.323833 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:31.323747    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-ft798" event={"ID":"cb6cdec6-48d6-43fb-820d-a526aa844e01","Type":"ContainerStarted","Data":"23b932cb7a5fae0bc4d5299bafb41d7088c1f7d66c80341ec436c14841211b70"}
Sep 09 23:15:32.732366 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.732327    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"]
Sep 09 23:15:32.741083 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.741053    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:32.744054 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.744026    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-blg4q\""
Sep 09 23:15:32.744291 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.744273    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 09 23:15:32.748601 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.748558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"]
Sep 09 23:15:32.844992 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.844959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fknk\" (UniqueName: \"kubernetes.io/projected/b1884d93-a654-4d5a-b983-cac836114034-kube-api-access-4fknk\") pod \"dns-operator-controller-manager-7b84cd7c9c-jgdc5\" (UID: \"b1884d93-a654-4d5a-b983-cac836114034\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:32.946166 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.946136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fknk\" (UniqueName: \"kubernetes.io/projected/b1884d93-a654-4d5a-b983-cac836114034-kube-api-access-4fknk\") pod \"dns-operator-controller-manager-7b84cd7c9c-jgdc5\" (UID: \"b1884d93-a654-4d5a-b983-cac836114034\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:32.955280 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:32.955255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fknk\" (UniqueName: \"kubernetes.io/projected/b1884d93-a654-4d5a-b983-cac836114034-kube-api-access-4fknk\") pod \"dns-operator-controller-manager-7b84cd7c9c-jgdc5\" (UID: \"b1884d93-a654-4d5a-b983-cac836114034\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:33.055119 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:33.055034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:33.522028 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:33.521998    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"]
Sep 09 23:15:33.525945 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:33.525905    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1884d93_a654_4d5a_b983_cac836114034.slice/crio-f4d45fb8b77753f750a9beb7d46a023f343f6518fcd1d7c596aaaf13e5c6fcff WatchSource:0}: Error finding container f4d45fb8b77753f750a9beb7d46a023f343f6518fcd1d7c596aaaf13e5c6fcff: Status 404 returned error can't find the container with id f4d45fb8b77753f750a9beb7d46a023f343f6518fcd1d7c596aaaf13e5c6fcff
Sep 09 23:15:34.338687 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:34.338647    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-ft798" event={"ID":"cb6cdec6-48d6-43fb-820d-a526aa844e01","Type":"ContainerStarted","Data":"b510ede3bf52a1aac5e7e62ccfea815aab2613fe0f38befd1939323e31dd64e7"}
Sep 09 23:15:34.339178 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:34.338776    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:34.340077 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:34.340053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5" event={"ID":"b1884d93-a654-4d5a-b983-cac836114034","Type":"ContainerStarted","Data":"f4d45fb8b77753f750a9beb7d46a023f343f6518fcd1d7c596aaaf13e5c6fcff"}
Sep 09 23:15:34.387958 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:34.387898    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-ft798" podStartSLOduration=2.08731329 podStartE2EDuration="4.387860086s" totalImagesPullingTime="2.300546796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:34.379530283 +0000 UTC m=+390.987897290" watchObservedRunningTime="2026-09-09 23:15:34.387860086 +0000 UTC m=+390.996227095"
Sep 09 23:15:35.345514 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:35.345479    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5" event={"ID":"b1884d93-a654-4d5a-b983-cac836114034","Type":"ContainerStarted","Data":"858eb6f17927e27e2a130d1046916303bf246a20eb7362802e415f9c104e457d"}
Sep 09 23:15:35.345965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:35.345546    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:35.363491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:35.363424    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5" podStartSLOduration=1.949184035 podStartE2EDuration="3.363406651s" totalImagesPullingTime="1.414222616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:35.361968051 +0000 UTC m=+391.970335058" watchObservedRunningTime="2026-09-09 23:15:35.363406651 +0000 UTC m=+391.971773658"
Sep 09 23:15:37.054171 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.054131    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"]
Sep 09 23:15:37.057326 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.057303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.059409 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.059389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qsgxv\""
Sep 09 23:15:37.078993 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.078972    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"]
Sep 09 23:15:37.182579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.182544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr9wh\" (UniqueName: \"kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.182579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.182582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.283200 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.283158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr9wh\" (UniqueName: \"kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.283386 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.283207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.283620 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.283598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.295642 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.295614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr9wh\" (UniqueName: \"kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh\") pod \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.366381 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.366302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:37.638569 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:37.638543    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"]
Sep 09 23:15:37.641015 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:37.640987    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod785c4a4d_71cd_446a_b88e_2c1d10d3b7a3.slice/crio-9a02ae9e31db18e52636f6d3e23c71377e3eff4e4d1038f9cdd2d5a5e486c55c WatchSource:0}: Error finding container 9a02ae9e31db18e52636f6d3e23c71377e3eff4e4d1038f9cdd2d5a5e486c55c: Status 404 returned error can't find the container with id 9a02ae9e31db18e52636f6d3e23c71377e3eff4e4d1038f9cdd2d5a5e486c55c
Sep 09 23:15:38.359516 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:38.359483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c" event={"ID":"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3","Type":"ContainerStarted","Data":"9a02ae9e31db18e52636f6d3e23c71377e3eff4e4d1038f9cdd2d5a5e486c55c"}
Sep 09 23:15:39.032441 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.032394    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"]
Sep 09 23:15:39.035931 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.035901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:39.038424 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.038393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-slwq2\""
Sep 09 23:15:39.047375 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.047347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"]
Sep 09 23:15:39.197510 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.197479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcr4s\" (UniqueName: \"kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s\") pod \"limitador-operator-controller-manager-74495c69f8-lzf2z\" (UID: \"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:39.298266 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.298168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcr4s\" (UniqueName: \"kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s\") pod \"limitador-operator-controller-manager-74495c69f8-lzf2z\" (UID: \"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:39.306498 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.306475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcr4s\" (UniqueName: \"kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s\") pod \"limitador-operator-controller-manager-74495c69f8-lzf2z\" (UID: \"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:39.349369 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.349334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:39.627704 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:39.627618    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"]
Sep 09 23:15:39.631013 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:39.630950    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cb8bea_d6a4_4f62_b419_a5bb1d71180b.slice/crio-78168748296f03b4f6823dd2b69e90718e716c932c6f39eee3cc0c8e684891c7 WatchSource:0}: Error finding container 78168748296f03b4f6823dd2b69e90718e716c932c6f39eee3cc0c8e684891c7: Status 404 returned error can't find the container with id 78168748296f03b4f6823dd2b69e90718e716c932c6f39eee3cc0c8e684891c7
Sep 09 23:15:40.370628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:40.370598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z" event={"ID":"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b","Type":"ContainerStarted","Data":"78168748296f03b4f6823dd2b69e90718e716c932c6f39eee3cc0c8e684891c7"}
Sep 09 23:15:41.378848 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:41.378801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c" event={"ID":"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3","Type":"ContainerStarted","Data":"4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771"}
Sep 09 23:15:41.379319 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:41.378936    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:41.402708 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:41.402592    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c" podStartSLOduration=0.909841202 podStartE2EDuration="4.402573988s" totalImagesPullingTime="3.492732786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:41.401732978 +0000 UTC m=+398.010099985" watchObservedRunningTime="2026-09-09 23:15:41.402573988 +0000 UTC m=+398.010940996"
Sep 09 23:15:42.384982 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:42.384947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z" event={"ID":"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b","Type":"ContainerStarted","Data":"e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e"}
Sep 09 23:15:42.385343 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:42.385021    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:42.427998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:42.427952    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z" podStartSLOduration=1.141698046 podStartE2EDuration="3.427934869s" totalImagesPullingTime="2.286236823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:42.427634113 +0000 UTC m=+399.036001122" watchObservedRunningTime="2026-09-09 23:15:42.427934869 +0000 UTC m=+399.036301875"
Sep 09 23:15:43.892071 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.892042    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"]
Sep 09 23:15:43.895197 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.895177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:43.897297 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.897272    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 09 23:15:43.897416 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.897316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l4b6r\""
Sep 09 23:15:43.897476 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.897425    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 09 23:15:43.901303 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:43.901283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"]
Sep 09 23:15:44.035357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.035323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99ca6998-bbf5-422c-b4f6-06d5948a0557-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.035357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.035363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.035566 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.035421    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd2cv\" (UniqueName: \"kubernetes.io/projected/99ca6998-bbf5-422c-b4f6-06d5948a0557-kube-api-access-zd2cv\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.136460 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.136425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99ca6998-bbf5-422c-b4f6-06d5948a0557-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.136625 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.136472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.136625 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.136504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd2cv\" (UniqueName: \"kubernetes.io/projected/99ca6998-bbf5-422c-b4f6-06d5948a0557-kube-api-access-zd2cv\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.136698 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:44.136641    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 09 23:15:44.136736 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:44.136701    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert podName:99ca6998-bbf5-422c-b4f6-06d5948a0557 nodeName:}" failed. No retries permitted until 2026-09-09 23:15:44.636685311 +0000 UTC m=+401.245052301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-clz6h" (UID: "99ca6998-bbf5-422c-b4f6-06d5948a0557") : secret "plugin-serving-cert" not found
Sep 09 23:15:44.137085 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.137065    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/99ca6998-bbf5-422c-b4f6-06d5948a0557-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.144389 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.144345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd2cv\" (UniqueName: \"kubernetes.io/projected/99ca6998-bbf5-422c-b4f6-06d5948a0557-kube-api-access-zd2cv\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.642221 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.642177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.644636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.644605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/99ca6998-bbf5-422c-b4f6-06d5948a0557-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-clz6h\" (UID: \"99ca6998-bbf5-422c-b4f6-06d5948a0557\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:44.804707 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:44.804669    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"
Sep 09 23:15:45.077791 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:45.077757    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h"]
Sep 09 23:15:45.081418 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:45.081388    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ca6998_bbf5_422c_b4f6_06d5948a0557.slice/crio-eacfa6bad23a05864a8dd3cee42ea8b6e17edb0cbc17304fc63bbc8aabc58734 WatchSource:0}: Error finding container eacfa6bad23a05864a8dd3cee42ea8b6e17edb0cbc17304fc63bbc8aabc58734: Status 404 returned error can't find the container with id eacfa6bad23a05864a8dd3cee42ea8b6e17edb0cbc17304fc63bbc8aabc58734
Sep 09 23:15:45.348343 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:45.348259    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-ft798"
Sep 09 23:15:45.398910 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:45.398861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h" event={"ID":"99ca6998-bbf5-422c-b4f6-06d5948a0557","Type":"ContainerStarted","Data":"eacfa6bad23a05864a8dd3cee42ea8b6e17edb0cbc17304fc63bbc8aabc58734"}
Sep 09 23:15:46.352313 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:46.352282    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-jgdc5"
Sep 09 23:15:50.421483 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:50.421448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h" event={"ID":"99ca6998-bbf5-422c-b4f6-06d5948a0557","Type":"ContainerStarted","Data":"289ee1b3301190148cd858455e2206b37fdb07cf08790ccd6bd549f54bfb97c2"}
Sep 09 23:15:50.437470 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:50.437424    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-clz6h" podStartSLOduration=3.065286528 podStartE2EDuration="7.437407115s" totalImagesPullingTime="4.372120587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:50.436314391 +0000 UTC m=+407.044681399" watchObservedRunningTime="2026-09-09 23:15:50.437407115 +0000 UTC m=+407.045774121"
Sep 09 23:15:52.387699 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:52.387667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:53.391251 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:53.391222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.478128 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.478092    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"]
Sep 09 23:15:54.478553 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.478310    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" containerName="manager" containerID="cri-o://4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771" gracePeriod=2
Sep 09 23:15:54.491283 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.491259    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"]
Sep 09 23:15:54.501138 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.501099    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\": pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.506926 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.506895    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"]
Sep 09 23:15:54.507127 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.507103    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" containerName="manager" containerID="cri-o://e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e" gracePeriod=2
Sep 09 23:15:54.511157 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.511132    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:15:54.511461 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.511446    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" containerName="manager"
Sep 09 23:15:54.511548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.511465    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" containerName="manager"
Sep 09 23:15:54.511604 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.511550    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" containerName="manager"
Sep 09 23:15:54.515365 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.515346    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.519221 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.519195    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"]
Sep 09 23:15:54.529037 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.529006    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:15:54.529719 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.529692    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-lzf2z\": pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.531625 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.531598    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.533793 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.533763    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.538710 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.538686    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"]
Sep 09 23:15:54.539100 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.539081    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" containerName="manager"
Sep 09 23:15:54.539100 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.539100    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" containerName="manager"
Sep 09 23:15:54.539244 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.539181    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" containerName="manager"
Sep 09 23:15:54.542216 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.542196    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:54.560972 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.560941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"]
Sep 09 23:15:54.565543 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.565511    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.567509 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.567487    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.584154 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.584124    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.624123 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.624065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvfr6\" (UniqueName: \"kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.624298 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.624131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.725321 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.725289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvfr6\" (UniqueName: \"kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.725473 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.725327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.725473 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.725351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8lnd\" (UniqueName: \"kubernetes.io/projected/9f31ccfb-53ab-4720-a1d9-d3199f25c818-kube-api-access-x8lnd\") pod \"limitador-operator-controller-manager-74495c69f8-52g99\" (UID: \"9f31ccfb-53ab-4720-a1d9-d3199f25c818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:54.725753 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.725728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.733955 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.733935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvfr6\" (UniqueName: \"kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-46frk\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.755656 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.755634    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.757522 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.757498    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.757734 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.757719    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.759274 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.759250    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.760995 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.760974    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:54.762651 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:54.762633    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:54.826197 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.826161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8lnd\" (UniqueName: \"kubernetes.io/projected/9f31ccfb-53ab-4720-a1d9-d3199f25c818-kube-api-access-x8lnd\") pod \"limitador-operator-controller-manager-74495c69f8-52g99\" (UID: \"9f31ccfb-53ab-4720-a1d9-d3199f25c818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:54.842207 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.842185    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8lnd\" (UniqueName: \"kubernetes.io/projected/9f31ccfb-53ab-4720-a1d9-d3199f25c818-kube-api-access-x8lnd\") pod \"limitador-operator-controller-manager-74495c69f8-52g99\" (UID: \"9f31ccfb-53ab-4720-a1d9-d3199f25c818\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:54.922619 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.922587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:54.926647 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.926621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr9wh\" (UniqueName: \"kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh\") pod \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") "
Sep 09 23:15:54.926709 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.926677    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume\") pod \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\" (UID: \"785c4a4d-71cd-446a-b88e-2c1d10d3b7a3\") "
Sep 09 23:15:54.926764 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.926723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcr4s\" (UniqueName: \"kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s\") pod \"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\" (UID: \"f6cb8bea-d6a4-4f62-b419-a5bb1d71180b\") "
Sep 09 23:15:54.927212 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.927175    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" (UID: "785c4a4d-71cd-446a-b88e-2c1d10d3b7a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:15:54.928859 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.928838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:54.928859 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.928875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s" (OuterVolumeSpecName: "kube-api-access-lcr4s") pod "f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" (UID: "f6cb8bea-d6a4-4f62-b419-a5bb1d71180b"). InnerVolumeSpecName "kube-api-access-lcr4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:15:54.928859 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:54.928910    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh" (OuterVolumeSpecName: "kube-api-access-nr9wh") pod "785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" (UID: "785c4a4d-71cd-446a-b88e-2c1d10d3b7a3"). InnerVolumeSpecName "kube-api-access-nr9wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:15:55.027491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.027457    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr9wh\" (UniqueName: \"kubernetes.io/projected/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-kube-api-access-nr9wh\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:15:55.027491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.027484    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3-extensions-socket-volume\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:15:55.027491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.027495    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcr4s\" (UniqueName: \"kubernetes.io/projected/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b-kube-api-access-lcr4s\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:15:55.198096 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.198065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:15:55.200742 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:55.200714    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945c9b0c_2d13_46ba_8307_07fa08090989.slice/crio-910cea1c76155cc8cc085958b260c0410ce74b45c717a86c9daa537300bdb82b WatchSource:0}: Error finding container 910cea1c76155cc8cc085958b260c0410ce74b45c717a86c9daa537300bdb82b: Status 404 returned error can't find the container with id 910cea1c76155cc8cc085958b260c0410ce74b45c717a86c9daa537300bdb82b
Sep 09 23:15:55.212129 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.212106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"]
Sep 09 23:15:55.213878 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:15:55.213844    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f31ccfb_53ab_4720_a1d9_d3199f25c818.slice/crio-403c506ef9a9d51321da613c1b71af2f4a81e6e816b419ed81974502775153f4 WatchSource:0}: Error finding container 403c506ef9a9d51321da613c1b71af2f4a81e6e816b419ed81974502775153f4: Status 404 returned error can't find the container with id 403c506ef9a9d51321da613c1b71af2f4a81e6e816b419ed81974502775153f4
Sep 09 23:15:55.443315 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.443277    2564 generic.go:356] "Generic (PLEG): container finished" podID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" containerID="4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771" exitCode=0
Sep 09 23:15:55.443489 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.443329    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:55.443489 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.443384    2564 scope.go:117] "RemoveContainer" containerID="4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771"
Sep 09 23:15:55.445502 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.445469    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:55.445785 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.445759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99" event={"ID":"9f31ccfb-53ab-4720-a1d9-d3199f25c818","Type":"ContainerStarted","Data":"711ebea0cd4202c4417b4b06a88c6bef9449b4c23bdc84ec524d7da42c4c6d79"}
Sep 09 23:15:55.445918 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.445853    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:15:55.445918 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.445900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99" event={"ID":"9f31ccfb-53ab-4720-a1d9-d3199f25c818","Type":"ContainerStarted","Data":"403c506ef9a9d51321da613c1b71af2f4a81e6e816b419ed81974502775153f4"}
Sep 09 23:15:55.447198 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.447163    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:55.447786 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.447753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" event={"ID":"945c9b0c-2d13-46ba-8307-07fa08090989","Type":"ContainerStarted","Data":"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"}
Sep 09 23:15:55.447929 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.447816    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" event={"ID":"945c9b0c-2d13-46ba-8307-07fa08090989","Type":"ContainerStarted","Data":"910cea1c76155cc8cc085958b260c0410ce74b45c717a86c9daa537300bdb82b"}
Sep 09 23:15:55.447929 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.447841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:15:55.448757 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.448732    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:55.449226 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.449203    2564 generic.go:356] "Generic (PLEG): container finished" podID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" containerID="e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e" exitCode=0
Sep 09 23:15:55.449299 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.449260    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:55.453818 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.453795    2564 scope.go:117] "RemoveContainer" containerID="4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771"
Sep 09 23:15:55.454206 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.454181    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771\": container with ID starting with 4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771 not found: ID does not exist" containerID="4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771"
Sep 09 23:15:55.454288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.454215    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771"} err="failed to get container status \"4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771\": rpc error: code = NotFound desc = could not find container \"4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771\": container with ID starting with 4209aa96b2b41c84ab8c9c5b9c9d676bec5f42d6eecddc68b380048d19994771 not found: ID does not exist"
Sep 09 23:15:55.454288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.454236    2564 scope.go:117] "RemoveContainer" containerID="e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e"
Sep 09 23:15:55.463271 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.463254    2564 scope.go:117] "RemoveContainer" containerID="e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e"
Sep 09 23:15:55.463586 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.463558    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e\": container with ID starting with e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e not found: ID does not exist" containerID="e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e"
Sep 09 23:15:55.463644 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.463591    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e"} err="failed to get container status \"e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e\": rpc error: code = NotFound desc = could not find container \"e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e\": container with ID starting with e72fb05c816d7e18b671ca4ee6b1e991016c83c70c2aba3a28195dbdd563f35e not found: ID does not exist"
Sep 09 23:15:55.470536 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.470499    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99" podStartSLOduration=1.4704857599999999 podStartE2EDuration="1.47048576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:55.469547151 +0000 UTC m=+412.077914158" watchObservedRunningTime="2026-09-09 23:15:55.47048576 +0000 UTC m=+412.078852766"
Sep 09 23:15:55.471850 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.471824    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:55.473281 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.473260    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-k5f5c\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-k5f5c"
Sep 09 23:15:55.474769 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:15:55.474746    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-lzf2z\" is forbidden: User \"system:node:ip-10-0-143-254.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-254.ec2.internal' and this object" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-lzf2z"
Sep 09 23:15:55.497254 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.497180    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" podStartSLOduration=1.497168872 podStartE2EDuration="1.497168872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:15:55.495841864 +0000 UTC m=+412.104208871" watchObservedRunningTime="2026-09-09 23:15:55.497168872 +0000 UTC m=+412.105535878"
Sep 09 23:15:55.892269 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.892186    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="785c4a4d-71cd-446a-b88e-2c1d10d3b7a3" path="/var/lib/kubelet/pods/785c4a4d-71cd-446a-b88e-2c1d10d3b7a3/volumes"
Sep 09 23:15:55.892505 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:15:55.892492    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6cb8bea-d6a4-4f62-b419-a5bb1d71180b" path="/var/lib/kubelet/pods/f6cb8bea-d6a4-4f62-b419-a5bb1d71180b/volumes"
Sep 09 23:16:06.458651 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:06.458618    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-52g99"
Sep 09 23:16:06.459049 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:06.458695    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:16:10.434182 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.434146    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:16:10.434657 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.434362    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" podUID="945c9b0c-2d13-46ba-8307-07fa08090989" containerName="manager" containerID="cri-o://2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa" gracePeriod=10
Sep 09 23:16:10.649905 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.649850    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"]
Sep 09 23:16:10.653169 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.653151    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.674769 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.674742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"]
Sep 09 23:16:10.676616 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.676588    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:16:10.747603 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.747578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvfr6\" (UniqueName: \"kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6\") pod \"945c9b0c-2d13-46ba-8307-07fa08090989\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") "
Sep 09 23:16:10.747778 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.747653    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume\") pod \"945c9b0c-2d13-46ba-8307-07fa08090989\" (UID: \"945c9b0c-2d13-46ba-8307-07fa08090989\") "
Sep 09 23:16:10.747845 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.747773    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faffb382-e070-4e30-be25-ee52b6476f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.747845 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.747803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t5pc\" (UniqueName: \"kubernetes.io/projected/faffb382-e070-4e30-be25-ee52b6476f2e-kube-api-access-2t5pc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.748039 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.748017    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "945c9b0c-2d13-46ba-8307-07fa08090989" (UID: "945c9b0c-2d13-46ba-8307-07fa08090989"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 23:16:10.749629 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.749609    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6" (OuterVolumeSpecName: "kube-api-access-kvfr6") pod "945c9b0c-2d13-46ba-8307-07fa08090989" (UID: "945c9b0c-2d13-46ba-8307-07fa08090989"). InnerVolumeSpecName "kube-api-access-kvfr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:10.848569 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.848533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t5pc\" (UniqueName: \"kubernetes.io/projected/faffb382-e070-4e30-be25-ee52b6476f2e-kube-api-access-2t5pc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.848744 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.848608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faffb382-e070-4e30-be25-ee52b6476f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.848744 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.848650    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c9b0c-2d13-46ba-8307-07fa08090989-extensions-socket-volume\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:16:10.848744 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.848660    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvfr6\" (UniqueName: \"kubernetes.io/projected/945c9b0c-2d13-46ba-8307-07fa08090989-kube-api-access-kvfr6\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:16:10.848999 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.848982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/faffb382-e070-4e30-be25-ee52b6476f2e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.864714 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.864684    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t5pc\" (UniqueName: \"kubernetes.io/projected/faffb382-e070-4e30-be25-ee52b6476f2e-kube-api-access-2t5pc\") pod \"kuadrant-operator-controller-manager-5769f99d9f-bwqlz\" (UID: \"faffb382-e070-4e30-be25-ee52b6476f2e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:10.971357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:10.971326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:11.246340 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.246191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"]
Sep 09 23:16:11.249037 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:16:11.249010    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaffb382_e070_4e30_be25_ee52b6476f2e.slice/crio-0fef633a38f6b47575fdb0295a39a62024c8a55050bf12e37bbdf7568b1cda87 WatchSource:0}: Error finding container 0fef633a38f6b47575fdb0295a39a62024c8a55050bf12e37bbdf7568b1cda87: Status 404 returned error can't find the container with id 0fef633a38f6b47575fdb0295a39a62024c8a55050bf12e37bbdf7568b1cda87
Sep 09 23:16:11.519053 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.519007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz" event={"ID":"faffb382-e070-4e30-be25-ee52b6476f2e","Type":"ContainerStarted","Data":"53f9d29ada8cc507f47a9d96bf97c723fc3bec16289e220b1506c45640fc288a"}
Sep 09 23:16:11.519497 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.519077    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:11.519497 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.519102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz" event={"ID":"faffb382-e070-4e30-be25-ee52b6476f2e","Type":"ContainerStarted","Data":"0fef633a38f6b47575fdb0295a39a62024c8a55050bf12e37bbdf7568b1cda87"}
Sep 09 23:16:11.520417 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.520394    2564 generic.go:356] "Generic (PLEG): container finished" podID="945c9b0c-2d13-46ba-8307-07fa08090989" containerID="2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa" exitCode=0
Sep 09 23:16:11.520520 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.520434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"
Sep 09 23:16:11.520520 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.520441    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" event={"ID":"945c9b0c-2d13-46ba-8307-07fa08090989","Type":"ContainerDied","Data":"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"}
Sep 09 23:16:11.520520 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.520474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk" event={"ID":"945c9b0c-2d13-46ba-8307-07fa08090989","Type":"ContainerDied","Data":"910cea1c76155cc8cc085958b260c0410ce74b45c717a86c9daa537300bdb82b"}
Sep 09 23:16:11.520520 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.520495    2564 scope.go:117] "RemoveContainer" containerID="2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"
Sep 09 23:16:11.529415 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.529395    2564 scope.go:117] "RemoveContainer" containerID="2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"
Sep 09 23:16:11.529669 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:16:11.529653    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa\": container with ID starting with 2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa not found: ID does not exist" containerID="2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"
Sep 09 23:16:11.529724 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.529675    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa"} err="failed to get container status \"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa\": rpc error: code = NotFound desc = could not find container \"2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa\": container with ID starting with 2e1fb637859843715bb5533770395b668c40e674f0320b42b082e7b7fcc85caa not found: ID does not exist"
Sep 09 23:16:11.539254 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.539205    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz" podStartSLOduration=1.539190018 podStartE2EDuration="1.539190018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:11.538336544 +0000 UTC m=+428.146703545" watchObservedRunningTime="2026-09-09 23:16:11.539190018 +0000 UTC m=+428.147557025"
Sep 09 23:16:11.559328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.559301    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:16:11.565833 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.565803    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-46frk"]
Sep 09 23:16:11.891759 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:11.891673    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="945c9b0c-2d13-46ba-8307-07fa08090989" path="/var/lib/kubelet/pods/945c9b0c-2d13-46ba-8307-07fa08090989/volumes"
Sep 09 23:16:22.527618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:22.527584    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-bwqlz"
Sep 09 23:16:39.545583 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.545503    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:39.546064 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.545780    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945c9b0c-2d13-46ba-8307-07fa08090989" containerName="manager"
Sep 09 23:16:39.546064 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.545790    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="945c9b0c-2d13-46ba-8307-07fa08090989" containerName="manager"
Sep 09 23:16:39.546064 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.545842    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="945c9b0c-2d13-46ba-8307-07fa08090989" containerName="manager"
Sep 09 23:16:39.548689 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.548672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.551203 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.551184    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 23:16:39.557097 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.557074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:39.651366 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.651325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:39.661945 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.661907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.662102 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.661959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plft4\" (UniqueName: \"kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.762362 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.762322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.762548 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.762385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plft4\" (UniqueName: \"kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.763020 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.762998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.771985 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.771961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plft4\" (UniqueName: \"kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4\") pod \"limitador-limitador-8588749977-lllxr\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") " pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:39.859152 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:39.859058    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:40.126585 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.126514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:40.129647 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:16:40.129619    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bf5a39_d9d4_4cc7_ac05_300c95b5f9c5.slice/crio-71cb48ee98237d98875dc26c7ff4aad7cc84f44993e8e377fb98ab4ddefe78ee WatchSource:0}: Error finding container 71cb48ee98237d98875dc26c7ff4aad7cc84f44993e8e377fb98ab4ddefe78ee: Status 404 returned error can't find the container with id 71cb48ee98237d98875dc26c7ff4aad7cc84f44993e8e377fb98ab4ddefe78ee
Sep 09 23:16:40.328440 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.328404    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:40.332620 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.332597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:40.334647 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.334625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vrxlr\""
Sep 09 23:16:40.345884 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.345640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:40.468130 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.468100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbnc\" (UniqueName: \"kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc\") pod \"authorino-7bcfd8f9cd-tdsn7\" (UID: \"ec9d3c99-e20d-4897-bae2-a4b022313b82\") " pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:40.474115 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.474086    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:16:40.477242 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.477222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:16:40.482987 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.482965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:16:40.569409 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.569372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4mh\" (UniqueName: \"kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh\") pod \"authorino-59c974bd48-7qs4k\" (UID: \"777c4f8e-58e4-464c-9fae-590866b23a90\") " pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:16:40.569803 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.569434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbnc\" (UniqueName: \"kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc\") pod \"authorino-7bcfd8f9cd-tdsn7\" (UID: \"ec9d3c99-e20d-4897-bae2-a4b022313b82\") " pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:40.576746 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.576721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbnc\" (UniqueName: \"kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc\") pod \"authorino-7bcfd8f9cd-tdsn7\" (UID: \"ec9d3c99-e20d-4897-bae2-a4b022313b82\") " pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:40.644978 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.644947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:40.647862 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.647828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" event={"ID":"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5","Type":"ContainerStarted","Data":"71cb48ee98237d98875dc26c7ff4aad7cc84f44993e8e377fb98ab4ddefe78ee"}
Sep 09 23:16:40.670213 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.670182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4mh\" (UniqueName: \"kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh\") pod \"authorino-59c974bd48-7qs4k\" (UID: \"777c4f8e-58e4-464c-9fae-590866b23a90\") " pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:16:40.677168 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.677141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4mh\" (UniqueName: \"kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh\") pod \"authorino-59c974bd48-7qs4k\" (UID: \"777c4f8e-58e4-464c-9fae-590866b23a90\") " pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:16:40.786705 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.786629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:16:40.911734 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:40.911690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:40.915244 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:16:40.915216    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec9d3c99_e20d_4897_bae2_a4b022313b82.slice/crio-25d63af4d771bd9e422bb1c3703eda00f8864b4945c622713b5d10bd01f891a9 WatchSource:0}: Error finding container 25d63af4d771bd9e422bb1c3703eda00f8864b4945c622713b5d10bd01f891a9: Status 404 returned error can't find the container with id 25d63af4d771bd9e422bb1c3703eda00f8864b4945c622713b5d10bd01f891a9
Sep 09 23:16:41.061929 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.061836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:16:41.167311 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:16:41.167280    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod777c4f8e_58e4_464c_9fae_590866b23a90.slice/crio-938ce379c5e3ad00b03eb7a084bad2970c2460db4ae896fb30be04d07ea860ab WatchSource:0}: Error finding container 938ce379c5e3ad00b03eb7a084bad2970c2460db4ae896fb30be04d07ea860ab: Status 404 returned error can't find the container with id 938ce379c5e3ad00b03eb7a084bad2970c2460db4ae896fb30be04d07ea860ab
Sep 09 23:16:41.657441 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.657403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" event={"ID":"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5","Type":"ContainerStarted","Data":"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"}
Sep 09 23:16:41.657935 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.657647    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:41.658851 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.658820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qs4k" event={"ID":"777c4f8e-58e4-464c-9fae-590866b23a90","Type":"ContainerStarted","Data":"938ce379c5e3ad00b03eb7a084bad2970c2460db4ae896fb30be04d07ea860ab"}
Sep 09 23:16:41.660174 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.660147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" event={"ID":"ec9d3c99-e20d-4897-bae2-a4b022313b82","Type":"ContainerStarted","Data":"25d63af4d771bd9e422bb1c3703eda00f8864b4945c622713b5d10bd01f891a9"}
Sep 09 23:16:41.672437 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:41.672361    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" podStartSLOduration=1.582511023 podStartE2EDuration="2.672339236s" totalImagesPullingTime="1.089828213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:41.672016965 +0000 UTC m=+458.280383973" watchObservedRunningTime="2026-09-09 23:16:41.672339236 +0000 UTC m=+458.280706265"
Sep 09 23:16:42.666230 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:42.666196    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qs4k" event={"ID":"777c4f8e-58e4-464c-9fae-590866b23a90","Type":"ContainerStarted","Data":"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"}
Sep 09 23:16:42.667759 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:42.667730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" event={"ID":"ec9d3c99-e20d-4897-bae2-a4b022313b82","Type":"ContainerStarted","Data":"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"}
Sep 09 23:16:42.680060 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:42.680019    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-7qs4k" podStartSLOduration=1.638949685 podStartE2EDuration="2.680005175s" totalImagesPullingTime="1.04105549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:42.679412436 +0000 UTC m=+459.287779443" watchObservedRunningTime="2026-09-09 23:16:42.680005175 +0000 UTC m=+459.288372181"
Sep 09 23:16:42.691833 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:42.691783    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" podStartSLOduration=1.399381314 podStartE2EDuration="2.691768043s" totalImagesPullingTime="1.292386729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:42.691124414 +0000 UTC m=+459.299491434" watchObservedRunningTime="2026-09-09 23:16:42.691768043 +0000 UTC m=+459.300135051"
Sep 09 23:16:42.718172 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:42.718145    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:44.677118 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:44.677082    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" podUID="ec9d3c99-e20d-4897-bae2-a4b022313b82" containerName="authorino" containerID="cri-o://982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76" gracePeriod=30
Sep 09 23:16:44.909669 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:44.909642    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:45.004626 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.004592    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrbnc\" (UniqueName: \"kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc\") pod \"ec9d3c99-e20d-4897-bae2-a4b022313b82\" (UID: \"ec9d3c99-e20d-4897-bae2-a4b022313b82\") "
Sep 09 23:16:45.006629 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.006602    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc" (OuterVolumeSpecName: "kube-api-access-qrbnc") pod "ec9d3c99-e20d-4897-bae2-a4b022313b82" (UID: "ec9d3c99-e20d-4897-bae2-a4b022313b82"). InnerVolumeSpecName "kube-api-access-qrbnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:45.105375 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.105335    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrbnc\" (UniqueName: \"kubernetes.io/projected/ec9d3c99-e20d-4897-bae2-a4b022313b82-kube-api-access-qrbnc\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:16:45.682065 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.682025    2564 generic.go:356] "Generic (PLEG): container finished" podID="ec9d3c99-e20d-4897-bae2-a4b022313b82" containerID="982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76" exitCode=0
Sep 09 23:16:45.682065 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.682067    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7"
Sep 09 23:16:45.682506 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.682070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" event={"ID":"ec9d3c99-e20d-4897-bae2-a4b022313b82","Type":"ContainerDied","Data":"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"}
Sep 09 23:16:45.682506 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.682107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-tdsn7" event={"ID":"ec9d3c99-e20d-4897-bae2-a4b022313b82","Type":"ContainerDied","Data":"25d63af4d771bd9e422bb1c3703eda00f8864b4945c622713b5d10bd01f891a9"}
Sep 09 23:16:45.682506 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.682150    2564 scope.go:117] "RemoveContainer" containerID="982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"
Sep 09 23:16:45.690736 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.690715    2564 scope.go:117] "RemoveContainer" containerID="982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"
Sep 09 23:16:45.691025 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:16:45.691005    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76\": container with ID starting with 982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76 not found: ID does not exist" containerID="982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"
Sep 09 23:16:45.691093 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.691034    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76"} err="failed to get container status \"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76\": rpc error: code = NotFound desc = could not find container \"982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76\": container with ID starting with 982c45f25250209866bf87a7324b1c50ae9db3cfad9d87b2b7ad343a0c50ff76 not found: ID does not exist"
Sep 09 23:16:45.701496 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.701472    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:45.708796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.708774    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-tdsn7"]
Sep 09 23:16:45.892077 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:45.892044    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9d3c99-e20d-4897-bae2-a4b022313b82" path="/var/lib/kubelet/pods/ec9d3c99-e20d-4897-bae2-a4b022313b82/volumes"
Sep 09 23:16:52.669328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:52.669297    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:52.671809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:52.671785    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:52.714076 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:52.714042    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" podUID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" containerName="limitador" containerID="cri-o://e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b" gracePeriod=30
Sep 09 23:16:53.251686 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.251661    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:53.368895 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.368779    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plft4\" (UniqueName: \"kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4\") pod \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") "
Sep 09 23:16:53.369066 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.368899    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file\") pod \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\" (UID: \"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5\") "
Sep 09 23:16:53.369239 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.369216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file" (OuterVolumeSpecName: "config-file") pod "06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" (UID: "06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 23:16:53.370998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.370965    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4" (OuterVolumeSpecName: "kube-api-access-plft4") pod "06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" (UID: "06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5"). InnerVolumeSpecName "kube-api-access-plft4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:16:53.469575 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.469544    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plft4\" (UniqueName: \"kubernetes.io/projected/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-kube-api-access-plft4\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:16:53.469575 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.469571    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5-config-file\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:16:53.719765 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.719725    2564 generic.go:356] "Generic (PLEG): container finished" podID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" containerID="e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b" exitCode=0
Sep 09 23:16:53.720253 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.719788    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lllxr"
Sep 09 23:16:53.720253 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.719802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" event={"ID":"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5","Type":"ContainerDied","Data":"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"}
Sep 09 23:16:53.720253 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.719888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lllxr" event={"ID":"06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5","Type":"ContainerDied","Data":"71cb48ee98237d98875dc26c7ff4aad7cc84f44993e8e377fb98ab4ddefe78ee"}
Sep 09 23:16:53.720253 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.719916    2564 scope.go:117] "RemoveContainer" containerID="e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"
Sep 09 23:16:53.727676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.727657    2564 scope.go:117] "RemoveContainer" containerID="e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"
Sep 09 23:16:53.728047 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:16:53.728024    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b\": container with ID starting with e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b not found: ID does not exist" containerID="e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"
Sep 09 23:16:53.728131 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.728052    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b"} err="failed to get container status \"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b\": rpc error: code = NotFound desc = could not find container \"e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b\": container with ID starting with e4438a870f3161c58fa6be0897b3757b4d39059053779ad2ddcc99d9492fe71b not found: ID does not exist"
Sep 09 23:16:53.739448 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.739420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:53.742783 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.742765    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lllxr"]
Sep 09 23:16:53.891495 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:53.891463    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" path="/var/lib/kubelet/pods/06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5/volumes"
Sep 09 23:16:55.270511 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.270479    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"]
Sep 09 23:16:55.270916 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.270900    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" containerName="limitador"
Sep 09 23:16:55.270960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.270919    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" containerName="limitador"
Sep 09 23:16:55.270960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.270952    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9d3c99-e20d-4897-bae2-a4b022313b82" containerName="authorino"
Sep 09 23:16:55.271016 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.270960    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9d3c99-e20d-4897-bae2-a4b022313b82" containerName="authorino"
Sep 09 23:16:55.271051 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.271028    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9d3c99-e20d-4897-bae2-a4b022313b82" containerName="authorino"
Sep 09 23:16:55.271051 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.271040    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bf5a39-d9d4-4cc7-ac05-300c95b5f9c5" containerName="limitador"
Sep 09 23:16:55.275528 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.275508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.277644 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.277619    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 23:16:55.277788 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.277698    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 23:16:55.277788 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.277627    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 23:16:55.278188 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.278174    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lgwfz\""
Sep 09 23:16:55.283565 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.283542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"]
Sep 09 23:16:55.384348 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.384312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db874fa1-5063-472a-ad22-86e47e18d671-data\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.384507 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.384361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt7hg\" (UniqueName: \"kubernetes.io/projected/db874fa1-5063-472a-ad22-86e47e18d671-kube-api-access-wt7hg\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.485674 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.485635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db874fa1-5063-472a-ad22-86e47e18d671-data\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.485849 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.485680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt7hg\" (UniqueName: \"kubernetes.io/projected/db874fa1-5063-472a-ad22-86e47e18d671-kube-api-access-wt7hg\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.486040 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.486019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/db874fa1-5063-472a-ad22-86e47e18d671-data\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.493567 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.493549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt7hg\" (UniqueName: \"kubernetes.io/projected/db874fa1-5063-472a-ad22-86e47e18d671-kube-api-access-wt7hg\") pod \"postgres-69fb4594cf-hhdwp\" (UID: \"db874fa1-5063-472a-ad22-86e47e18d671\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.588341 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.588253    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:55.862202 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:55.862125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"]
Sep 09 23:16:55.864859 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:16:55.864830    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb874fa1_5063_472a_ad22_86e47e18d671.slice/crio-414449f8a40210a460016e1152a84c59a6a8bf46b4129d02ffb55ab960353535 WatchSource:0}: Error finding container 414449f8a40210a460016e1152a84c59a6a8bf46b4129d02ffb55ab960353535: Status 404 returned error can't find the container with id 414449f8a40210a460016e1152a84c59a6a8bf46b4129d02ffb55ab960353535
Sep 09 23:16:56.735655 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:56.735618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp" event={"ID":"db874fa1-5063-472a-ad22-86e47e18d671","Type":"ContainerStarted","Data":"414449f8a40210a460016e1152a84c59a6a8bf46b4129d02ffb55ab960353535"}
Sep 09 23:16:58.746355 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:58.746320    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp" event={"ID":"db874fa1-5063-472a-ad22-86e47e18d671","Type":"ContainerStarted","Data":"eaeecc8fbd7e3c2ac3e47e755d8fe13ce17c217c2409cc603752762411ae615a"}
Sep 09 23:16:58.746798 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:58.746440    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:16:58.761885 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:16:58.761829    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp" podStartSLOduration=1.831851408 podStartE2EDuration="3.761815189s" totalImagesPullingTime="1.929963781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:58.760402991 +0000 UTC m=+475.368770000" watchObservedRunningTime="2026-09-09 23:16:58.761815189 +0000 UTC m=+475.370182196"
Sep 09 23:17:04.779161 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:04.779129    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hhdwp"
Sep 09 23:17:05.293579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.293543    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-t8tsz"]
Sep 09 23:17:05.300063 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.300040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.303363 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.303338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-t8tsz"]
Sep 09 23:17:05.443351 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.443318    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-t8tsz"]
Sep 09 23:17:05.443577 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:17:05.443555    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jtxjd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-t8tsz" podUID="c1ee7ce6-4a14-4fce-afdb-444ce71adb7e"
Sep 09 23:17:05.463883 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.463835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxjd\" (UniqueName: \"kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd\") pod \"authorino-557f876f69-t8tsz\" (UID: \"c1ee7ce6-4a14-4fce-afdb-444ce71adb7e\") " pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.565050 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.564973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxjd\" (UniqueName: \"kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd\") pod \"authorino-557f876f69-t8tsz\" (UID: \"c1ee7ce6-4a14-4fce-afdb-444ce71adb7e\") " pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.588490 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.588457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxjd\" (UniqueName: \"kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd\") pod \"authorino-557f876f69-t8tsz\" (UID: \"c1ee7ce6-4a14-4fce-afdb-444ce71adb7e\") " pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.632372 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.632344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f66bd4bf6-7h47l"]
Sep 09 23:17:05.636676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.636654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.638886 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.638849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 23:17:05.647034 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.647010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66bd4bf6-7h47l"]
Sep 09 23:17:05.767483 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.767446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a4221b1-4a48-4b77-94e7-5393d72ab918-tls-cert\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.767661 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.767490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhvb4\" (UniqueName: \"kubernetes.io/projected/2a4221b1-4a48-4b77-94e7-5393d72ab918-kube-api-access-nhvb4\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.774998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.774972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.782589 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.782561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:05.868450 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.868370    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtxjd\" (UniqueName: \"kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd\") pod \"c1ee7ce6-4a14-4fce-afdb-444ce71adb7e\" (UID: \"c1ee7ce6-4a14-4fce-afdb-444ce71adb7e\") "
Sep 09 23:17:05.868587 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.868521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a4221b1-4a48-4b77-94e7-5393d72ab918-tls-cert\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.868587 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.868551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhvb4\" (UniqueName: \"kubernetes.io/projected/2a4221b1-4a48-4b77-94e7-5393d72ab918-kube-api-access-nhvb4\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.870447 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.870412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd" (OuterVolumeSpecName: "kube-api-access-jtxjd") pod "c1ee7ce6-4a14-4fce-afdb-444ce71adb7e" (UID: "c1ee7ce6-4a14-4fce-afdb-444ce71adb7e"). InnerVolumeSpecName "kube-api-access-jtxjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:17:05.870814 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.870795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2a4221b1-4a48-4b77-94e7-5393d72ab918-tls-cert\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.876784 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.876761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhvb4\" (UniqueName: \"kubernetes.io/projected/2a4221b1-4a48-4b77-94e7-5393d72ab918-kube-api-access-nhvb4\") pod \"authorino-7f66bd4bf6-7h47l\" (UID: \"2a4221b1-4a48-4b77-94e7-5393d72ab918\") " pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.946318 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.946284    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66bd4bf6-7h47l"
Sep 09 23:17:05.969403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:05.969378    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtxjd\" (UniqueName: \"kubernetes.io/projected/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e-kube-api-access-jtxjd\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:17:06.216270 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:06.215753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66bd4bf6-7h47l"]
Sep 09 23:17:06.219844 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:17:06.219815    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a4221b1_4a48_4b77_94e7_5393d72ab918.slice/crio-af8a4ffea312f535b72da3ec7c9e15212b092996680d60a774d789bc6046b419 WatchSource:0}: Error finding container af8a4ffea312f535b72da3ec7c9e15212b092996680d60a774d789bc6046b419: Status 404 returned error can't find the container with id af8a4ffea312f535b72da3ec7c9e15212b092996680d60a774d789bc6046b419
Sep 09 23:17:06.784278 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:06.784244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-t8tsz"
Sep 09 23:17:06.784672 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:06.784245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66bd4bf6-7h47l" event={"ID":"2a4221b1-4a48-4b77-94e7-5393d72ab918","Type":"ContainerStarted","Data":"af8a4ffea312f535b72da3ec7c9e15212b092996680d60a774d789bc6046b419"}
Sep 09 23:17:06.818783 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:06.818752    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-t8tsz"]
Sep 09 23:17:06.824246 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:06.824219    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-t8tsz"]
Sep 09 23:17:07.790361 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:07.790327    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66bd4bf6-7h47l" event={"ID":"2a4221b1-4a48-4b77-94e7-5393d72ab918","Type":"ContainerStarted","Data":"8ba93bc5f71d684476c3fb2d244a03b532629bc94882e2398c741319af3842d7"}
Sep 09 23:17:07.807000 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:07.806947    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f66bd4bf6-7h47l" podStartSLOduration=1.9067330729999998 podStartE2EDuration="2.806927049s" totalImagesPullingTime="900.193976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:07.806234078 +0000 UTC m=+484.414601083" watchObservedRunningTime="2026-09-09 23:17:07.806927049 +0000 UTC m=+484.415294060"
Sep 09 23:17:07.842375 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:07.842341    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:17:07.842576 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:07.842552    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-7qs4k" podUID="777c4f8e-58e4-464c-9fae-590866b23a90" containerName="authorino" containerID="cri-o://d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa" gracePeriod=30
Sep 09 23:17:07.892667 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:07.892638    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1ee7ce6-4a14-4fce-afdb-444ce71adb7e" path="/var/lib/kubelet/pods/c1ee7ce6-4a14-4fce-afdb-444ce71adb7e/volumes"
Sep 09 23:17:08.089708 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.089683    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:17:08.186093 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.186045    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk4mh\" (UniqueName: \"kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh\") pod \"777c4f8e-58e4-464c-9fae-590866b23a90\" (UID: \"777c4f8e-58e4-464c-9fae-590866b23a90\") "
Sep 09 23:17:08.188080 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.188057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh" (OuterVolumeSpecName: "kube-api-access-tk4mh") pod "777c4f8e-58e4-464c-9fae-590866b23a90" (UID: "777c4f8e-58e4-464c-9fae-590866b23a90"). InnerVolumeSpecName "kube-api-access-tk4mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:17:08.286755 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.286723    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk4mh\" (UniqueName: \"kubernetes.io/projected/777c4f8e-58e4-464c-9fae-590866b23a90-kube-api-access-tk4mh\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:17:08.795776 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.795738    2564 generic.go:356] "Generic (PLEG): container finished" podID="777c4f8e-58e4-464c-9fae-590866b23a90" containerID="d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa" exitCode=0
Sep 09 23:17:08.796267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.795779    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qs4k"
Sep 09 23:17:08.796267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.795826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qs4k" event={"ID":"777c4f8e-58e4-464c-9fae-590866b23a90","Type":"ContainerDied","Data":"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"}
Sep 09 23:17:08.796267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.795891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qs4k" event={"ID":"777c4f8e-58e4-464c-9fae-590866b23a90","Type":"ContainerDied","Data":"938ce379c5e3ad00b03eb7a084bad2970c2460db4ae896fb30be04d07ea860ab"}
Sep 09 23:17:08.796267 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.795916    2564 scope.go:117] "RemoveContainer" containerID="d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"
Sep 09 23:17:08.806372 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.806294    2564 scope.go:117] "RemoveContainer" containerID="d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"
Sep 09 23:17:08.806902 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:17:08.806860    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa\": container with ID starting with d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa not found: ID does not exist" containerID="d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"
Sep 09 23:17:08.806995 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.806909    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa"} err="failed to get container status \"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa\": rpc error: code = NotFound desc = could not find container \"d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa\": container with ID starting with d9bcbb290229d6bab487a88b971d9cfd27d5e2ce120025f69afca4151edbe0aa not found: ID does not exist"
Sep 09 23:17:08.817478 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.817454    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:17:08.822185 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:08.822161    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qs4k"]
Sep 09 23:17:09.892455 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:09.892414    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="777c4f8e-58e4-464c-9fae-590866b23a90" path="/var/lib/kubelet/pods/777c4f8e-58e4-464c-9fae-590866b23a90/volumes"
Sep 09 23:17:12.666266 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.666227    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:12.666648 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.666534    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="777c4f8e-58e4-464c-9fae-590866b23a90" containerName="authorino"
Sep 09 23:17:12.666648 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.666545    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="777c4f8e-58e4-464c-9fae-590866b23a90" containerName="authorino"
Sep 09 23:17:12.666648 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.666594    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="777c4f8e-58e4-464c-9fae-590866b23a90" containerName="authorino"
Sep 09 23:17:12.671045 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.671029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.673319 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.673291    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 23:17:12.674147 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.674112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 23:17:12.674147 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.674141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5dljk\""
Sep 09 23:17:12.674456 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.674434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 23:17:12.679818 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.679795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:12.821098 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.821065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j92z6\" (UniqueName: \"kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.821275 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.821107    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.821275 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.821183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.834453 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.834420    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-849b8bc99-nbtpc"]
Sep 09 23:17:12.837631 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.837615    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:12.848127 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.848100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-849b8bc99-nbtpc"]
Sep 09 23:17:12.921862 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.921765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.921862 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.921831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j92z6\" (UniqueName: \"kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.922138 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.921899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.924246 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.924223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.924350 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.924326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.929581 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.929557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j92z6\" (UniqueName: \"kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6\") pod \"maas-controller-794dccd5d8-cftcb\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") " pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:12.982462 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:12.982430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:13.022643 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.022594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-metrics-certs\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.022813 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.022690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22zfh\" (UniqueName: \"kubernetes.io/projected/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-kube-api-access-22zfh\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.022813 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.022739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-webhook-cert\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.123992 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.123957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-metrics-certs\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.124175 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.124020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22zfh\" (UniqueName: \"kubernetes.io/projected/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-kube-api-access-22zfh\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.124175 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.124053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-webhook-cert\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.126387 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.126359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-metrics-certs\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.126530 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.126507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-webhook-cert\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.132306 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.132284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22zfh\" (UniqueName: \"kubernetes.io/projected/6cc4b4a6-a6aa-40d2-831a-df55e13e68c6-kube-api-access-22zfh\") pod \"maas-controller-849b8bc99-nbtpc\" (UID: \"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6\") " pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.147230 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.147197    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:13.250669 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.250642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:13.253263 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:17:13.253237    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada3c052_466d_4c36_937b_309f0871835a.slice/crio-a4409c47437df95b9042db2cef255452ba59536e8b860aa987cf82f1a6638d62 WatchSource:0}: Error finding container a4409c47437df95b9042db2cef255452ba59536e8b860aa987cf82f1a6638d62: Status 404 returned error can't find the container with id a4409c47437df95b9042db2cef255452ba59536e8b860aa987cf82f1a6638d62
Sep 09 23:17:13.418410 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.418321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-849b8bc99-nbtpc"]
Sep 09 23:17:13.420930 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:17:13.420908    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc4b4a6_a6aa_40d2_831a_df55e13e68c6.slice/crio-2ae12018bbf62ea92a636e2e280274564e83aba9a66a0be1718d038a96fef12d WatchSource:0}: Error finding container 2ae12018bbf62ea92a636e2e280274564e83aba9a66a0be1718d038a96fef12d: Status 404 returned error can't find the container with id 2ae12018bbf62ea92a636e2e280274564e83aba9a66a0be1718d038a96fef12d
Sep 09 23:17:13.819101 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.819064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849b8bc99-nbtpc" event={"ID":"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6","Type":"ContainerStarted","Data":"2ae12018bbf62ea92a636e2e280274564e83aba9a66a0be1718d038a96fef12d"}
Sep 09 23:17:13.820235 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:13.820213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dccd5d8-cftcb" event={"ID":"ada3c052-466d-4c36-937b-309f0871835a","Type":"ContainerStarted","Data":"a4409c47437df95b9042db2cef255452ba59536e8b860aa987cf82f1a6638d62"}
Sep 09 23:17:16.838973 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.838927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-849b8bc99-nbtpc" event={"ID":"6cc4b4a6-a6aa-40d2-831a-df55e13e68c6","Type":"ContainerStarted","Data":"8d7080c270bdd83ee4e9a7b7deafd64d837ff8499bd0c60684c63e5b075771bd"}
Sep 09 23:17:16.839402 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.839095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:16.840311 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.840291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dccd5d8-cftcb" event={"ID":"ada3c052-466d-4c36-937b-309f0871835a","Type":"ContainerStarted","Data":"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"}
Sep 09 23:17:16.840431 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.840418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:16.857291 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.857243    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-849b8bc99-nbtpc" podStartSLOduration=2.30173489 podStartE2EDuration="4.857229189s" totalImagesPullingTime="2.555494299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:16.856079575 +0000 UTC m=+493.464446582" watchObservedRunningTime="2026-09-09 23:17:16.857229189 +0000 UTC m=+493.465596196"
Sep 09 23:17:16.872406 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:16.872358    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-794dccd5d8-cftcb" podStartSLOduration=2.159285987 podStartE2EDuration="4.872343288s" totalImagesPullingTime="2.713057301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:16.870999813 +0000 UTC m=+493.479366822" watchObservedRunningTime="2026-09-09 23:17:16.872343288 +0000 UTC m=+493.480710294"
Sep 09 23:17:27.847608 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:27.847574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:27.848018 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:27.847644    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-849b8bc99-nbtpc"
Sep 09 23:17:27.909970 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:27.909934    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:27.910183 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:27.910159    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-794dccd5d8-cftcb" podUID="ada3c052-466d-4c36-937b-309f0871835a" containerName="manager" containerID="cri-o://1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48" gracePeriod=30
Sep 09 23:17:28.155105 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.155080    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:28.236662 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.236621    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert\") pod \"ada3c052-466d-4c36-937b-309f0871835a\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") "
Sep 09 23:17:28.236809 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.236691    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j92z6\" (UniqueName: \"kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6\") pod \"ada3c052-466d-4c36-937b-309f0871835a\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") "
Sep 09 23:17:28.236896 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.236810    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs\") pod \"ada3c052-466d-4c36-937b-309f0871835a\" (UID: \"ada3c052-466d-4c36-937b-309f0871835a\") "
Sep 09 23:17:28.238951 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.238913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ada3c052-466d-4c36-937b-309f0871835a" (UID: "ada3c052-466d-4c36-937b-309f0871835a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:17:28.238951 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.238931    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ada3c052-466d-4c36-937b-309f0871835a" (UID: "ada3c052-466d-4c36-937b-309f0871835a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 23:17:28.239095 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.238982    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6" (OuterVolumeSpecName: "kube-api-access-j92z6") pod "ada3c052-466d-4c36-937b-309f0871835a" (UID: "ada3c052-466d-4c36-937b-309f0871835a"). InnerVolumeSpecName "kube-api-access-j92z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 23:17:28.337408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.337371    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-metrics-certs\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:17:28.337408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.337399    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada3c052-466d-4c36-937b-309f0871835a-webhook-cert\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:17:28.337408 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.337410    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j92z6\" (UniqueName: \"kubernetes.io/projected/ada3c052-466d-4c36-937b-309f0871835a-kube-api-access-j92z6\") on node \"ip-10-0-143-254.ec2.internal\" DevicePath \"\""
Sep 09 23:17:28.893183 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.893146    2564 generic.go:356] "Generic (PLEG): container finished" podID="ada3c052-466d-4c36-937b-309f0871835a" containerID="1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48" exitCode=0
Sep 09 23:17:28.893642 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.893188    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-794dccd5d8-cftcb"
Sep 09 23:17:28.893642 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.893230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dccd5d8-cftcb" event={"ID":"ada3c052-466d-4c36-937b-309f0871835a","Type":"ContainerDied","Data":"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"}
Sep 09 23:17:28.893642 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.893287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-794dccd5d8-cftcb" event={"ID":"ada3c052-466d-4c36-937b-309f0871835a","Type":"ContainerDied","Data":"a4409c47437df95b9042db2cef255452ba59536e8b860aa987cf82f1a6638d62"}
Sep 09 23:17:28.893642 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.893321    2564 scope.go:117] "RemoveContainer" containerID="1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"
Sep 09 23:17:28.901906 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.901888    2564 scope.go:117] "RemoveContainer" containerID="1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"
Sep 09 23:17:28.902186 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:17:28.902168    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48\": container with ID starting with 1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48 not found: ID does not exist" containerID="1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"
Sep 09 23:17:28.902250 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.902195    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48"} err="failed to get container status \"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48\": rpc error: code = NotFound desc = could not find container \"1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48\": container with ID starting with 1df2d15dc610bbe59e7b348bad44345cb4bd9ebd0aaaa414ee269294b20edc48 not found: ID does not exist"
Sep 09 23:17:28.912578 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.912554    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:28.918974 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:28.918951    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-794dccd5d8-cftcb"]
Sep 09 23:17:29.892242 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:29.892207    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada3c052-466d-4c36-937b-309f0871835a" path="/var/lib/kubelet/pods/ada3c052-466d-4c36-937b-309f0871835a/volumes"
Sep 09 23:17:50.298892 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.298847    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"]
Sep 09 23:17:50.299307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.299168    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada3c052-466d-4c36-937b-309f0871835a" containerName="manager"
Sep 09 23:17:50.299307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.299180    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada3c052-466d-4c36-937b-309f0871835a" containerName="manager"
Sep 09 23:17:50.299307 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.299239    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada3c052-466d-4c36-937b-309f0871835a" containerName="manager"
Sep 09 23:17:50.307205 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.307181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.309389 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.309360    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 23:17:50.309823 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.309806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-68fkt\""
Sep 09 23:17:50.309962 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.309813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 23:17:50.313077 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.313053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"]
Sep 09 23:17:50.413115 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.413079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-metrics-certs\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.413288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.413125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-maas-api-tls\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.413288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.413154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-openshift-service-ca\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.413288 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.413229    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjt7\" (UniqueName: \"kubernetes.io/projected/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-kube-api-access-lcjt7\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.514175 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.514142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-openshift-service-ca\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.514368 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.514216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjt7\" (UniqueName: \"kubernetes.io/projected/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-kube-api-access-lcjt7\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.514368 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.514280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-metrics-certs\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.514368 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.514319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-maas-api-tls\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.515061 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.515034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-openshift-service-ca\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.516899 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.516857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-maas-api-tls\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.516998 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.516937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-metrics-certs\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.521691 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.521663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjt7\" (UniqueName: \"kubernetes.io/projected/ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce-kube-api-access-lcjt7\") pod \"maas-api-6d65bf8d58-5b5wx\" (UID: \"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce\") " pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.618423 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.618342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:50.862342 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.862305    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"]
Sep 09 23:17:50.867255 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.867227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:50.870988 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.870922    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 23:17:50.871208 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.871188    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vgzdb\""
Sep 09 23:17:50.885784 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.885747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"]
Sep 09 23:17:50.924188 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.924144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28719dc0-c39c-47eb-88a7-9e032c4e306d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:50.924378 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.924255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts6lx\" (UniqueName: \"kubernetes.io/projected/28719dc0-c39c-47eb-88a7-9e032c4e306d-kube-api-access-ts6lx\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:50.924813 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.924771    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"]
Sep 09 23:17:50.928129 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:17:50.928077    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4cd7bb_77f9_4942_a04e_4f9f6ebe30ce.slice/crio-9dd6855b1de1a733e7bb48990f3a435b27e8938caf0e788bdf4439fdd72cae88 WatchSource:0}: Error finding container 9dd6855b1de1a733e7bb48990f3a435b27e8938caf0e788bdf4439fdd72cae88: Status 404 returned error can't find the container with id 9dd6855b1de1a733e7bb48990f3a435b27e8938caf0e788bdf4439fdd72cae88
Sep 09 23:17:50.985758 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:50.985718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx" event={"ID":"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce","Type":"ContainerStarted","Data":"9dd6855b1de1a733e7bb48990f3a435b27e8938caf0e788bdf4439fdd72cae88"}
Sep 09 23:17:51.025256 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.025220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts6lx\" (UniqueName: \"kubernetes.io/projected/28719dc0-c39c-47eb-88a7-9e032c4e306d-kube-api-access-ts6lx\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:51.025441 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.025286    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28719dc0-c39c-47eb-88a7-9e032c4e306d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:51.026209 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.026178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28719dc0-c39c-47eb-88a7-9e032c4e306d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:51.036813 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.036787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts6lx\" (UniqueName: \"kubernetes.io/projected/28719dc0-c39c-47eb-88a7-9e032c4e306d-kube-api-access-ts6lx\") pod \"payload-processing-5b54b7fbb7-lm2wv\" (UID: \"28719dc0-c39c-47eb-88a7-9e032c4e306d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:51.179628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.179547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:51.448047 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.447966    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"]
Sep 09 23:17:51.451448 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:17:51.451418    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28719dc0_c39c_47eb_88a7_9e032c4e306d.slice/crio-a4e512a5a554b35b064385bc62b37247d776792614009fbfed6c44581beb2631 WatchSource:0}: Error finding container a4e512a5a554b35b064385bc62b37247d776792614009fbfed6c44581beb2631: Status 404 returned error can't find the container with id a4e512a5a554b35b064385bc62b37247d776792614009fbfed6c44581beb2631
Sep 09 23:17:51.992264 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:51.992224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv" event={"ID":"28719dc0-c39c-47eb-88a7-9e032c4e306d","Type":"ContainerStarted","Data":"a4e512a5a554b35b064385bc62b37247d776792614009fbfed6c44581beb2631"}
Sep 09 23:17:54.002505 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.002471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx" event={"ID":"ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce","Type":"ContainerStarted","Data":"5ddd771d98981bd9f76e3f11571b13b3d13ae667c50e793c398ffa63319c037c"}
Sep 09 23:17:54.002978 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.002573    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:17:54.004146 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.004126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv" event={"ID":"28719dc0-c39c-47eb-88a7-9e032c4e306d","Type":"ContainerStarted","Data":"f21dfbdd2d7f32264c8f1f923ea04dc1eb158a1db231ebc5e6bcca7b14923144"}
Sep 09 23:17:54.004300 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.004287    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:17:54.020374 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.020324    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx" podStartSLOduration=1.818221887 podStartE2EDuration="4.020308121s" totalImagesPullingTime="2.202086234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:54.01840781 +0000 UTC m=+530.626774817" watchObservedRunningTime="2026-09-09 23:17:54.020308121 +0000 UTC m=+530.628675128"
Sep 09 23:17:54.035840 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:17:54.035787    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv" podStartSLOduration=2.3118962659999998 podStartE2EDuration="4.035769204s" totalImagesPullingTime="1.723872938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:54.034609248 +0000 UTC m=+530.642976255" watchObservedRunningTime="2026-09-09 23:17:54.035769204 +0000 UTC m=+530.644136216"
Sep 09 23:18:00.013897 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:00.013799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d65bf8d58-5b5wx"
Sep 09 23:18:05.009925 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.009888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-lm2wv"
Sep 09 23:18:05.408075 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.407994    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"]
Sep 09 23:18:05.412790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.412756    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.414658 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.414639    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 23:18:05.415129 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.415112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 23:18:05.415221 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.415143    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 23:18:05.415221 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.415147    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fhsgd\""
Sep 09 23:18:05.419405 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.419383    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"]
Sep 09 23:18:05.542771 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.542733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.542994 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.542790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.542994 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.542824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b01f437-f98e-4872-aa10-12f12d5d822c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.542994 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.542850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.543123 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.542985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmg9\" (UniqueName: \"kubernetes.io/projected/8b01f437-f98e-4872-aa10-12f12d5d822c-kube-api-access-jqmg9\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.543123 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.543032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644148 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmg9\" (UniqueName: \"kubernetes.io/projected/8b01f437-f98e-4872-aa10-12f12d5d822c-kube-api-access-jqmg9\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b01f437-f98e-4872-aa10-12f12d5d822c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644739 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644810 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644713    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.644810 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.644764    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.646724 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.646692    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b01f437-f98e-4872-aa10-12f12d5d822c-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.646908 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.646890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b01f437-f98e-4872-aa10-12f12d5d822c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.651742 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.651717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmg9\" (UniqueName: \"kubernetes.io/projected/8b01f437-f98e-4872-aa10-12f12d5d822c-kube-api-access-jqmg9\") pod \"e2e-distinct-2-simulated-kserve-859856b874-6z8r4\" (UID: \"8b01f437-f98e-4872-aa10-12f12d5d822c\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.724729 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.724686    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:05.997628 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:05.997506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"]
Sep 09 23:18:06.000513 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:18:06.000484    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b01f437_f98e_4872_aa10_12f12d5d822c.slice/crio-55d485c97a7d4d12d5115af2ea1a3e665dff7baaf9ca5153d705c1c0f2a93ed1 WatchSource:0}: Error finding container 55d485c97a7d4d12d5115af2ea1a3e665dff7baaf9ca5153d705c1c0f2a93ed1: Status 404 returned error can't find the container with id 55d485c97a7d4d12d5115af2ea1a3e665dff7baaf9ca5153d705c1c0f2a93ed1
Sep 09 23:18:06.056017 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:06.055963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerStarted","Data":"55d485c97a7d4d12d5115af2ea1a3e665dff7baaf9ca5153d705c1c0f2a93ed1"}
Sep 09 23:18:08.067145 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:08.067104    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="91dca22dc580c3c1b52373241fda886bbc6bb9f8b6e42854018edc23b6cc1400" exitCode=0
Sep 09 23:18:08.067665 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:08.067184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"91dca22dc580c3c1b52373241fda886bbc6bb9f8b6e42854018edc23b6cc1400"}
Sep 09 23:18:08.067665 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:08.067373    2564 scope.go:117] "RemoveContainer" containerID="91dca22dc580c3c1b52373241fda886bbc6bb9f8b6e42854018edc23b6cc1400"
Sep 09 23:18:09.073521 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:09.073484    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9" exitCode=0
Sep 09 23:18:09.073521 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:09.073521    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"}
Sep 09 23:18:09.073978 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:09.073569    2564 scope.go:117] "RemoveContainer" containerID="91dca22dc580c3c1b52373241fda886bbc6bb9f8b6e42854018edc23b6cc1400"
Sep 09 23:18:09.073978 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:09.073794    2564 scope.go:117] "RemoveContainer" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"
Sep 09 23:18:09.074059 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:09.074012    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:18:10.079804 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:10.079777    2564 scope.go:117] "RemoveContainer" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"
Sep 09 23:18:10.080196 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:10.079954    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:18:15.725440 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:15.725395    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:15.725949 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:15.725496    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:15.725949 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:15.725528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:15.725949 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:15.725544    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:15.725949 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:15.725927    2564 scope.go:117] "RemoveContainer" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"
Sep 09 23:18:15.726109 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:15.726091    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:18:29.887701 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:29.887665    2564 scope.go:117] "RemoveContainer" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"
Sep 09 23:18:30.172432 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:30.172405    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4" exitCode=0
Sep 09 23:18:30.172572 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:30.172476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"}
Sep 09 23:18:30.172572 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:30.172556    2564 scope.go:117] "RemoveContainer" containerID="b39f113874b6cb13c7934949cddeab7fea16f163f40fbc0151ace36587eadbf9"
Sep 09 23:18:30.172923 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:30.172906    2564 scope.go:117] "RemoveContainer" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"
Sep 09 23:18:30.173123 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:30.173099    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:18:34.903206 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.903168    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"]
Sep 09 23:18:34.907790 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.907766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.909898 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.909853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 23:18:34.918638 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.918607    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"]
Sep 09 23:18:34.987960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.987920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.988150 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.987966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af45ec55-ee50-463d-a058-9a04f9deea34-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.988150 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.988021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.988150 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.988097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.988150 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.988134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:34.988320 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:34.988159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5l2\" (UniqueName: \"kubernetes.io/projected/af45ec55-ee50-463d-a058-9a04f9deea34-kube-api-access-8x5l2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089110 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089302 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089302 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089302 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5l2\" (UniqueName: \"kubernetes.io/projected/af45ec55-ee50-463d-a058-9a04f9deea34-kube-api-access-8x5l2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089302 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089302 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af45ec55-ee50-463d-a058-9a04f9deea34-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089541 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089541 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089460    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.089618 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.089545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.091526 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.091494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af45ec55-ee50-463d-a058-9a04f9deea34-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.091738 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.091721    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af45ec55-ee50-463d-a058-9a04f9deea34-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.097222 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.097202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5l2\" (UniqueName: \"kubernetes.io/projected/af45ec55-ee50-463d-a058-9a04f9deea34-kube-api-access-8x5l2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t\" (UID: \"af45ec55-ee50-463d-a058-9a04f9deea34\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.219909 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.219856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:35.492388 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.492359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"]
Sep 09 23:18:35.494639 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:18:35.494609    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf45ec55_ee50_463d_a058_9a04f9deea34.slice/crio-e9b7edd9fc77a1a640194da0a02370db5b483594bf0ab9356f9058c44fcc60ee WatchSource:0}: Error finding container e9b7edd9fc77a1a640194da0a02370db5b483594bf0ab9356f9058c44fcc60ee: Status 404 returned error can't find the container with id e9b7edd9fc77a1a640194da0a02370db5b483594bf0ab9356f9058c44fcc60ee
Sep 09 23:18:35.725501 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.725474    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:35.725611 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.725555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:35.725611 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.725570    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:35.725611 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.725583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:18:35.725966 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:35.725949    2564 scope.go:117] "RemoveContainer" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"
Sep 09 23:18:35.726148 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:35.726129    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:18:36.200737 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:36.200699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t" event={"ID":"af45ec55-ee50-463d-a058-9a04f9deea34","Type":"ContainerStarted","Data":"8ae0d20484ccaa6b76f725cf1d983fa606bb202984c73960da06c9eab12152de"}
Sep 09 23:18:36.201167 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:36.200759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t" event={"ID":"af45ec55-ee50-463d-a058-9a04f9deea34","Type":"ContainerStarted","Data":"e9b7edd9fc77a1a640194da0a02370db5b483594bf0ab9356f9058c44fcc60ee"}
Sep 09 23:18:36.217246 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:36.217194    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t" podStartSLOduration=2.039216006 podStartE2EDuration="2.217176636s" totalImagesPullingTime="177.96063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:36.216113898 +0000 UTC m=+572.824480908" watchObservedRunningTime="2026-09-09 23:18:36.217176636 +0000 UTC m=+572.825543642"
Sep 09 23:18:45.220454 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:45.220409    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:45.220821 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:45.220485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:45.233362 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:45.233331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:45.251014 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:45.250986    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t"
Sep 09 23:18:48.887354 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:18:48.887324    2564 scope.go:117] "RemoveContainer" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"
Sep 09 23:18:48.887815 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:18:48.887500    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:03.890156 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:03.890116    2564 scope.go:117] "RemoveContainer" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"
Sep 09 23:19:04.323290 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:04.323259    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b" exitCode=0
Sep 09 23:19:04.323451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:04.323326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"}
Sep 09 23:19:04.323451 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:04.323385    2564 scope.go:117] "RemoveContainer" containerID="edfc7137f943da37bd9e2712294530fd1fa9f7a0763b7b9f0bb35838c80e77d4"
Sep 09 23:19:04.323796 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:04.323778    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:04.323998 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:04.323980    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:05.725609 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:05.725561    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:05.727990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:05.725684    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:05.727990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:05.725712    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:05.727990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:05.725734    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:05.727990 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:05.726132    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:05.727990 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:05.726316    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:06.335834 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:06.335803    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:06.336047 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:06.335988    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:21.887356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:21.887324    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:21.887827 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:21.887493    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:33.129225 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.129142    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"]
Sep 09 23:19:33.137960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.137930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.140311 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.140291    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 09 23:19:33.144902 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.144850    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"]
Sep 09 23:19:33.178381 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.178562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.178562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.178562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.178562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpkh\" (UniqueName: \"kubernetes.io/projected/8adee587-8b46-4193-bd25-cb6dd42ef9fd-kube-api-access-mmpkh\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.178562 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.178559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279677 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279677 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpkh\" (UniqueName: \"kubernetes.io/projected/8adee587-8b46-4193-bd25-cb6dd42ef9fd-kube-api-access-mmpkh\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.279965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.279836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.280170 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.280144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.280170 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.280159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.280269 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.280246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.281956 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.281936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8adee587-8b46-4193-bd25-cb6dd42ef9fd-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.282350 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.282327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8adee587-8b46-4193-bd25-cb6dd42ef9fd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.288383 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.288357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpkh\" (UniqueName: \"kubernetes.io/projected/8adee587-8b46-4193-bd25-cb6dd42ef9fd-kube-api-access-mmpkh\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz\" (UID: \"8adee587-8b46-4193-bd25-cb6dd42ef9fd\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.449240 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.449155    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:33.726509 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.726473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"]
Sep 09 23:19:33.729358 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:19:33.729331    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adee587_8b46_4193_bd25_cb6dd42ef9fd.slice/crio-fba03f0533b4fbfbb2b15dd5484ba7e9138362d8449481caf58c56558a0118f3 WatchSource:0}: Error finding container fba03f0533b4fbfbb2b15dd5484ba7e9138362d8449481caf58c56558a0118f3: Status 404 returned error can't find the container with id fba03f0533b4fbfbb2b15dd5484ba7e9138362d8449481caf58c56558a0118f3
Sep 09 23:19:33.731158 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:33.731139    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 23:19:34.458174 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:34.458075    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="48da341a744b7806dec0a809419d3b45f061fcc5670d51c1d1a4cc19378b0774" exitCode=0
Sep 09 23:19:34.458174 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:34.458144    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"48da341a744b7806dec0a809419d3b45f061fcc5670d51c1d1a4cc19378b0774"}
Sep 09 23:19:34.458609 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:34.458181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerStarted","Data":"fba03f0533b4fbfbb2b15dd5484ba7e9138362d8449481caf58c56558a0118f3"}
Sep 09 23:19:34.458609 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:34.458398    2564 scope.go:117] "RemoveContainer" containerID="48da341a744b7806dec0a809419d3b45f061fcc5670d51c1d1a4cc19378b0774"
Sep 09 23:19:35.466843 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:35.466798    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453" exitCode=0
Sep 09 23:19:35.467328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:35.466930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"}
Sep 09 23:19:35.467328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:35.466995    2564 scope.go:117] "RemoveContainer" containerID="48da341a744b7806dec0a809419d3b45f061fcc5670d51c1d1a4cc19378b0774"
Sep 09 23:19:35.467328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:35.467264    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:35.467500 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:35.467482    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:19:35.887003 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:35.886918    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:35.887174 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:35.887141    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:36.474042 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:36.474013    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:36.474461 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:36.474182    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:19:43.450143 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.450104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:43.450538 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.450194    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:43.450538 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.450242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:43.450538 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.450260    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:19:43.450676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.450662    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:43.450853 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:43.450833    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:19:43.504170 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:43.504144    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:43.504349 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:43.504330    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:19:44.113197 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.113165    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"]
Sep 09 23:19:44.122500 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.122465    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.125175 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.125147    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 09 23:19:44.126529 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.126507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"]
Sep 09 23:19:44.177289 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.177289 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/3821687d-3cb5-4b38-9ee1-bd3723f253ff-kube-api-access-r6gq8\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.177552 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.177552 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.177552 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.177552 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.177538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278698 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278698 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278703    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/3821687d-3cb5-4b38-9ee1-bd3723f253ff-kube-api-access-r6gq8\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278944 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278944 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278944 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278795    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.278944 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.278812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.279153 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.279131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.279237 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.279217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.279295 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.279250    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.281107 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.281085    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3821687d-3cb5-4b38-9ee1-bd3723f253ff-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.281266 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.281251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3821687d-3cb5-4b38-9ee1-bd3723f253ff-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.285965 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.285946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6gq8\" (UniqueName: \"kubernetes.io/projected/3821687d-3cb5-4b38-9ee1-bd3723f253ff-kube-api-access-r6gq8\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb\" (UID: \"3821687d-3cb5-4b38-9ee1-bd3723f253ff\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.433576 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.433484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:44.703980 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:44.703728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"]
Sep 09 23:19:44.706835 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:19:44.706808    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3821687d_3cb5_4b38_9ee1_bd3723f253ff.slice/crio-e354db0e34926cad9e200aee13972345c7ba22df3b77b6993be47a6f6695d5ca WatchSource:0}: Error finding container e354db0e34926cad9e200aee13972345c7ba22df3b77b6993be47a6f6695d5ca: Status 404 returned error can't find the container with id e354db0e34926cad9e200aee13972345c7ba22df3b77b6993be47a6f6695d5ca
Sep 09 23:19:45.514319 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:45.514284    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="a93a903002fabde45f4538db525d94bf10ffc4d23a052a3817b63754a59495ae" exitCode=0
Sep 09 23:19:45.514532 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:45.514375    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"a93a903002fabde45f4538db525d94bf10ffc4d23a052a3817b63754a59495ae"}
Sep 09 23:19:45.514532 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:45.514412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerStarted","Data":"e354db0e34926cad9e200aee13972345c7ba22df3b77b6993be47a6f6695d5ca"}
Sep 09 23:19:45.514650 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:45.514621    2564 scope.go:117] "RemoveContainer" containerID="a93a903002fabde45f4538db525d94bf10ffc4d23a052a3817b63754a59495ae"
Sep 09 23:19:46.520905 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:46.520848    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a" exitCode=0
Sep 09 23:19:46.521357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:46.520933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"}
Sep 09 23:19:46.521357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:46.520980    2564 scope.go:117] "RemoveContainer" containerID="a93a903002fabde45f4538db525d94bf10ffc4d23a052a3817b63754a59495ae"
Sep 09 23:19:46.521357 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:46.521318    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:19:46.521543 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:46.521521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:19:47.527943 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:47.527916    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:19:47.528373 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:47.528095    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:19:49.887722 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:49.887686    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:50.542370 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:50.542334    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851" exitCode=0
Sep 09 23:19:50.542557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:50.542403    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"}
Sep 09 23:19:50.542557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:50.542466    2564 scope.go:117] "RemoveContainer" containerID="18c3b2093c03b70cb11f9a756003822a1d39da27be29a49f9e90c70898baab2b"
Sep 09 23:19:50.542813 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:50.542793    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:19:50.543031 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:50.543010    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:54.434308 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.434270    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:54.434793 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.434394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:54.434793 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.434424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:54.434793 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.434439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:19:54.434793 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.434754    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:19:54.434957 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:54.434937    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:19:54.567077 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:54.567051    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:19:54.567260 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:54.567241    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:19:55.725816 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:55.725773    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:55.726232 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:55.725898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:55.726232 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:55.725917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:55.726232 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:55.725930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:19:55.726335 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:55.726292    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:19:55.726491 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:55.726469    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:56.577474 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:56.577446    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:19:56.577643 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:56.577623    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:19:56.887422 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:56.887340    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:57.584187 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:57.584157    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51" exitCode=0
Sep 09 23:19:57.584356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:57.584229    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51"}
Sep 09 23:19:57.584356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:57.584290    2564 scope.go:117] "RemoveContainer" containerID="ef18a94c159ee2d9a474e071295523c73d7ffaba2249535b56c8eaf82d989453"
Sep 09 23:19:57.584654 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:19:57.584632    2564 scope.go:117] "RemoveContainer" containerID="3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51"
Sep 09 23:19:57.584891 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:19:57.584854    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:03.449349 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:03.449311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:03.449835 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:03.449374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:03.449835 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:03.449393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:03.449835 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:03.449405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:03.449835 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:03.449751    2564 scope.go:117] "RemoveContainer" containerID="3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51"
Sep 09 23:20:03.450062 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:03.449989    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:04.887671 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:04.887636    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:20:05.624236 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:05.624201    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d" exitCode=0
Sep 09 23:20:05.624403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:05.624278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d"}
Sep 09 23:20:05.624403 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:05.624330    2564 scope.go:117] "RemoveContainer" containerID="5516b04e9231ae2e1603b06ebf60e1221e01d5fa758a0bbfa18da108ea18c75a"
Sep 09 23:20:05.624665 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:05.624641    2564 scope.go:117] "RemoveContainer" containerID="430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d"
Sep 09 23:20:05.624846 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:05.624821    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:10.887721 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:10.887689    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:20:10.888239 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:10.887954    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:20:14.433812 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:14.433766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:14.434282 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:14.433828    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:14.434282 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:14.433840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:14.434282 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:14.433849    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:14.434282 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:14.434234    2564 scope.go:117] "RemoveContainer" containerID="430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d"
Sep 09 23:20:14.434456 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:14.434386    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:17.887625 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:17.887587    2564 scope.go:117] "RemoveContainer" containerID="3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51"
Sep 09 23:20:18.687043 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:18.687008    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd" exitCode=0
Sep 09 23:20:18.687243 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:18.687053    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"}
Sep 09 23:20:18.687243 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:18.687112    2564 scope.go:117] "RemoveContainer" containerID="3cc2bd454e9ae9bbd6304b599b3670efea4f14b3206bb7218a2615c2c9b1fb51"
Sep 09 23:20:18.687535 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:18.687512    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:20:18.687748 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:18.687723    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:21.887580 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:21.887549    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:20:21.887978 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:21.887715    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:20:23.449301 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:23.449257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:23.449673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:23.449331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:23.449673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:23.449357    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:23.449673 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:23.449374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:20:23.449778 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:23.449720    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:20:23.449924 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:23.449904    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:25.886953 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:25.886916    2564 scope.go:117] "RemoveContainer" containerID="430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d"
Sep 09 23:20:26.725437 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:26.725406    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8" exitCode=0
Sep 09 23:20:26.725603 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:26.725478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"}
Sep 09 23:20:26.725603 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:26.725521    2564 scope.go:117] "RemoveContainer" containerID="430ed52cd88c98a4db334e1e8f2789d1157117ecec50b1695a1945f0a597353d"
Sep 09 23:20:26.725878 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:26.725850    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:20:26.726091 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:26.726068    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:32.887481 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:32.887449    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:20:32.887902 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:32.887636    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:20:34.433771 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:34.433732    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:34.434186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:34.433787    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:34.434186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:34.433799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:34.434186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:34.433807    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:20:34.434186 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:34.434181    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:20:34.434351 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:34.434331    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:36.886925 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:36.886892    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:20:36.887330 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:36.887063    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:43.889086 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:43.889052    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:20:43.889554 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:43.889318    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:20:46.886897 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:46.886848    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:20:46.887256 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:46.887022    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:48.887085 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:48.887053    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:20:48.887456 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:48.887226    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:20:58.886592 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:58.886513    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:20:58.887099 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:58.886712    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:20:58.887099 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:20:58.886913    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:20:58.887099 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:20:58.887082    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:21:03.889061 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:03.889025    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:21:04.899840 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:04.899806    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19" exitCode=0
Sep 09 23:21:04.900291 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:04.899858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"}
Sep 09 23:21:04.900291 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:04.899924    2564 scope.go:117] "RemoveContainer" containerID="2a89891c64541a9bfc8ae525ea058adbdca60fdd641d7351704c6c8cfdc6c1fd"
Sep 09 23:21:04.900291 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:04.900206    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:21:04.900416 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:04.900383    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:21:12.886847 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:12.886805    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:21:13.450261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.450165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:21:13.450261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.450236    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:21:13.450261 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.450259    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:21:13.450533 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.450295    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:21:13.450700 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.450683    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:21:13.450939 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:13.450910    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:21:13.890621 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.890595    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:21:13.941713 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.941680    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1" exitCode=0
Sep 09 23:21:13.941907 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.941756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"}
Sep 09 23:21:13.941907 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.941807    2564 scope.go:117] "RemoveContainer" containerID="ce203a2e60e14e50f5fae59bae613f61a855b273a6980f7712438d491fea08c8"
Sep 09 23:21:13.942140 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:13.942127    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:21:13.942320 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:13.942303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:21:14.433891 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.433768    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:21:14.433891 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.433830    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:21:14.433891 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.433844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:21:14.433891 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.433857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:21:14.948117 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.948084    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:21:14.948549 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:14.948261    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:21:14.949681 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.949660    2564 generic.go:356] "Generic (PLEG): container finished" podID="8b01f437-f98e-4872-aa10-12f12d5d822c" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98" exitCode=0
Sep 09 23:21:14.949779 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.949738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" event={"ID":"8b01f437-f98e-4872-aa10-12f12d5d822c","Type":"ContainerDied","Data":"c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"}
Sep 09 23:21:14.949815 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.949798    2564 scope.go:117] "RemoveContainer" containerID="6cf2c0ad7ad907ebdd658b7e90dfd7012c4ca0fead614081bde8cd36a64a5851"
Sep 09 23:21:14.950138 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:14.950120    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:21:14.950286 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:14.950265    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:21:15.724961 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:15.724922    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:21:15.725133 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:15.725009    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:21:15.725133 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:15.725024    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:21:15.725133 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:15.725037    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4"
Sep 09 23:21:15.955836 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:15.955810    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:21:15.956217 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:15.955994    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:21:26.886679 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:26.886649    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:21:26.887133 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:26.886901    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:21:28.887517 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:28.887484    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:21:28.887917 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:28.887642    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:21:29.887466 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:29.887424    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:21:29.887730 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:29.887606    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:21:41.887177 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:41.887138    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:21:41.887639 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:41.887365    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:21:42.886888 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:42.886840    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:21:42.887058 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:42.887032    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:21:43.893099 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:43.893062    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:21:43.893566 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:43.893362    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:21:55.886738 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:55.886693    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:21:55.887167 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:55.886941    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:21:57.887378 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:57.887342    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:21:57.887749 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:57.887557    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:21:58.887681 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:21:58.887645    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:21:58.888176 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:21:58.887855    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:22:07.887035 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:07.887003    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:22:07.887634 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:07.887183    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:22:10.886764 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:10.886729    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:22:10.887254 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:10.887015    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:22:11.886978 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:11.886942    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:22:11.887463 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:11.887108    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:22:22.887688 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:22.887649    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:22:22.888187 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:22.887767    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:22:22.888187 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:22.887812    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:22:22.888187 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:22.888024    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:22:25.887207 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:25.887173    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:22:25.887615 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:25.887347    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:22:33.888685 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:33.888655    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:22:34.315245 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:34.315213    2564 generic.go:356] "Generic (PLEG): container finished" podID="8adee587-8b46-4193-bd25-cb6dd42ef9fd" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f" exitCode=0
Sep 09 23:22:34.315398 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:34.315287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" event={"ID":"8adee587-8b46-4193-bd25-cb6dd42ef9fd","Type":"ContainerDied","Data":"8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"}
Sep 09 23:22:34.315398 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:34.315349    2564 scope.go:117] "RemoveContainer" containerID="2e4b2f1bc3fe89642fe2e63a5dd9b448795302c7ad7b4eedd00d42e699de6e19"
Sep 09 23:22:34.315661 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:34.315638    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:22:34.315841 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:34.315823    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:22:37.887349 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:37.887316    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:22:38.337098 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:38.337063    2564 generic.go:356] "Generic (PLEG): container finished" podID="3821687d-3cb5-4b38-9ee1-bd3723f253ff" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57" exitCode=0
Sep 09 23:22:38.337254 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:38.337140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" event={"ID":"3821687d-3cb5-4b38-9ee1-bd3723f253ff","Type":"ContainerDied","Data":"5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"}
Sep 09 23:22:38.337254 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:38.337190    2564 scope.go:117] "RemoveContainer" containerID="9e10957b0784864a3a44cd37d350290b6e45109cc3e42926797e192e18126fb1"
Sep 09 23:22:38.337551 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:38.337529    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:22:38.337732 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:38.337711    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:22:38.886722 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:38.886688    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:22:38.886921 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:38.886898    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:22:43.450279 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:43.450238    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:22:43.450704 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:43.450307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:22:43.450704 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:43.450325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:22:43.450704 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:43.450339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz"
Sep 09 23:22:43.450818 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:43.450764    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:22:43.450999 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:43.450978    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:22:44.434491 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:44.434446    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:22:44.434686 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:44.434509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:22:44.434686 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:44.434521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:22:44.434686 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:44.434530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb"
Sep 09 23:22:44.434929 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:44.434916    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:22:44.435084 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:44.435065    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:22:52.887397 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:52.887359    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:22:52.887848 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:52.887554    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:22:55.886915 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:55.886856    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:22:55.887296 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:55.887058    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:22:57.887292 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:22:57.887259    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:22:57.887674 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:22:57.887428    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:23:04.415389 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:04.415355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_8adee587-8b46-4193-bd25-cb6dd42ef9fd/main/5.log"
Sep 09 23:23:04.529915 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:04.529862    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_8adee587-8b46-4193-bd25-cb6dd42ef9fd/main/5.log"
Sep 09 23:23:05.605330 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:05.605291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66bd4bf6-7h47l_2a4221b1-4a48-4b77-94e7-5393d72ab918/authorino/0.log"
Sep 09 23:23:06.886960 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:06.886932    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:23:06.887325 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:06.887003    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:23:06.887325 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:06.887116    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:23:06.887325 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:06.887139    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:23:11.035485 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:11.035441    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lxf7z_bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4/manager/0.log"
Sep 09 23:23:11.158656 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:11.158613    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-849b8bc99-nbtpc_6cc4b4a6-a6aa-40d2-831a-df55e13e68c6/manager/0.log"
Sep 09 23:23:11.649260 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:11.649232    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-9f5vq_66c4ab31-1340-4305-98ba-d9d87a012f39/manager/0.log"
Sep 09 23:23:11.655704 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:11.655682    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-9f5vq_66c4ab31-1340-4305-98ba-d9d87a012f39/copy-manifests/0.log"
Sep 09 23:23:12.109439 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:12.109407    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d65bf8d58-5b5wx_ae4cd7bb-77f9-4942-a04e-4f9f6ebe30ce/maas-api/0.log"
Sep 09 23:23:12.217063 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:12.217030    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hhdwp_db874fa1-5063-472a-ad22-86e47e18d671/postgres/0.log"
Sep 09 23:23:12.887384 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:12.887356    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:23:12.887565 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:12.887525    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:23:12.976171 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:12.976141    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66bd4bf6-7h47l_2a4221b1-4a48-4b77-94e7-5393d72ab918/authorino/0.log"
Sep 09 23:23:13.090593 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:13.090549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-ft798_cb6cdec6-48d6-43fb-820d-a526aa844e01/manager/0.log"
Sep 09 23:23:13.208683 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:13.208596    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-jgdc5_b1884d93-a654-4d5a-b983-cac836114034/manager/0.log"
Sep 09 23:23:13.320475 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:13.320448    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-clz6h_99ca6998-bbf5-422c-b4f6-06d5948a0557/kuadrant-console-plugin/0.log"
Sep 09 23:23:13.442787 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:13.442753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-bwqlz_faffb382-e070-4e30-be25-ee52b6476f2e/manager/0.log"
Sep 09 23:23:13.658693 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:13.658665    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-52g99_9f31ccfb-53ab-4720-a1d9-d3199f25c818/manager/0.log"
Sep 09 23:23:14.248008 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:14.247981    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-799c6f7f87-8d7rd_44619ef0-2867-4422-921b-c1742707cfe6/kube-auth-proxy/0.log"
Sep 09 23:23:14.707071 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:14.706984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lm2wv_28719dc0-c39c-47eb-88a7-9e032c4e306d/payload-processing/0.log"
Sep 09 23:23:15.158739 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:15.158698    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-6z8r4_8b01f437-f98e-4872-aa10-12f12d5d822c/main/5.log"
Sep 09 23:23:15.373503 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:15.373471    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-6sz5t_af45ec55-ee50-463d-a058-9a04f9deea34/main/0.log"
Sep 09 23:23:15.705383 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:15.705355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_8adee587-8b46-4193-bd25-cb6dd42ef9fd/main/5.log"
Sep 09 23:23:15.808188 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:15.808155    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_3821687d-3cb5-4b38-9ee1-bd3723f253ff/main/5.log"
Sep 09 23:23:20.887557 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:20.887530    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:23:20.887968 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:20.887626    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:23:20.887968 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:20.887707    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:23:20.887968 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:20.887769    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:23:24.104244 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:24.104208    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qdv4k_257017ea-db91-4cde-a617-e6c6cd64fba8/global-pull-secret-syncer/0.log"
Sep 09 23:23:24.175270 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:24.175243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jm4vm_b8695672-c0eb-4e6a-b551-6dac1cdd4188/konnectivity-agent/0.log"
Sep 09 23:23:24.271531 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:24.271502    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-254.ec2.internal_7a1b0e0c85c71eed0c06c4b54bd79641/haproxy/0.log"
Sep 09 23:23:25.886829 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:25.886796    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:23:25.887239 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:25.886995    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:23:28.259828 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.259793    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66bd4bf6-7h47l_2a4221b1-4a48-4b77-94e7-5393d72ab918/authorino/0.log"
Sep 09 23:23:28.288416 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.288387    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-ft798_cb6cdec6-48d6-43fb-820d-a526aa844e01/manager/0.log"
Sep 09 23:23:28.312528 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.312500    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-jgdc5_b1884d93-a654-4d5a-b983-cac836114034/manager/0.log"
Sep 09 23:23:28.337694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.337670    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-clz6h_99ca6998-bbf5-422c-b4f6-06d5948a0557/kuadrant-console-plugin/0.log"
Sep 09 23:23:28.392493 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.392469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-bwqlz_faffb382-e070-4e30-be25-ee52b6476f2e/manager/0.log"
Sep 09 23:23:28.451906 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:28.451880    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-52g99_9f31ccfb-53ab-4720-a1d9-d3199f25c818/manager/0.log"
Sep 09 23:23:30.647588 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:30.647561    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmjgp_164f5037-cb8d-4ab0-88b5-37aa397a2413/node-exporter/0.log"
Sep 09 23:23:30.665376 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:30.665347    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmjgp_164f5037-cb8d-4ab0-88b5-37aa397a2413/kube-rbac-proxy/0.log"
Sep 09 23:23:30.687850 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:30.687829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmjgp_164f5037-cb8d-4ab0-88b5-37aa397a2413/init-textfile/0.log"
Sep 09 23:23:33.888608 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.888577    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:23:33.889005 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:33.888756    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:23:33.968572 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.968535    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"]
Sep 09 23:23:33.971712 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.971696    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:33.973837 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.973790    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8sjk\"/\"kube-root-ca.crt\""
Sep 09 23:23:33.973837 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.973825    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b8sjk\"/\"openshift-service-ca.crt\""
Sep 09 23:23:33.974356 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.974336    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b8sjk\"/\"default-dockercfg-8p95c\""
Sep 09 23:23:33.984008 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:33.983988    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"]
Sep 09 23:23:34.025950 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.025894    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-lib-modules\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.026132 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.025967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-proc\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.026132 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.026012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6d6z\" (UniqueName: \"kubernetes.io/projected/305dc6f0-a1b6-491d-979f-eab7ed497b2f-kube-api-access-g6d6z\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.026219 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.026151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-podres\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.026219 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.026191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-sys\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.126997 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.126964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-podres\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-sys\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-lib-modules\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-proc\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6d6z\" (UniqueName: \"kubernetes.io/projected/305dc6f0-a1b6-491d-979f-eab7ed497b2f-kube-api-access-g6d6z\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-podres\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127162 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-sys\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127372 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-lib-modules\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.127372 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.127188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/305dc6f0-a1b6-491d-979f-eab7ed497b2f-proc\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.134298 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.134271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6d6z\" (UniqueName: \"kubernetes.io/projected/305dc6f0-a1b6-491d-979f-eab7ed497b2f-kube-api-access-g6d6z\") pod \"perf-node-gather-daemonset-5hnm6\" (UID: \"305dc6f0-a1b6-491d-979f-eab7ed497b2f\") " pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.281741 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.281705    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:34.552514 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.552485    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"]
Sep 09 23:23:34.554620 ip-10-0-143-254 kubenswrapper[2564]: W0909 23:23:34.554588    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod305dc6f0_a1b6_491d_979f_eab7ed497b2f.slice/crio-87e819a696c1db6303fbdf2284186bb5a929c0cf5fe6a03f8bbb84e0f42352c1 WatchSource:0}: Error finding container 87e819a696c1db6303fbdf2284186bb5a929c0cf5fe6a03f8bbb84e0f42352c1: Status 404 returned error can't find the container with id 87e819a696c1db6303fbdf2284186bb5a929c0cf5fe6a03f8bbb84e0f42352c1
Sep 09 23:23:34.591474 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.591442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6" event={"ID":"305dc6f0-a1b6-491d-979f-eab7ed497b2f","Type":"ContainerStarted","Data":"87e819a696c1db6303fbdf2284186bb5a929c0cf5fe6a03f8bbb84e0f42352c1"}
Sep 09 23:23:34.886752 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:34.886657    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:23:34.886946 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:34.886908    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:23:35.596806 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.596763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6" event={"ID":"305dc6f0-a1b6-491d-979f-eab7ed497b2f","Type":"ContainerStarted","Data":"3960c6668000cfb8149717b159019c491f592084f2299d886ebd74565e6de68e"}
Sep 09 23:23:35.597198 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.596904    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:35.611579 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.611531    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6" podStartSLOduration=2.611514906 podStartE2EDuration="2.611514906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:35.611062152 +0000 UTC m=+872.219429159" watchObservedRunningTime="2026-09-09 23:23:35.611514906 +0000 UTC m=+872.219881925"
Sep 09 23:23:35.756048 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.756021    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bxznx_aaafc10a-55f9-465c-b72e-6a757910facd/dns/0.log"
Sep 09 23:23:35.774830 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.774789    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bxznx_aaafc10a-55f9-465c-b72e-6a757910facd/kube-rbac-proxy/0.log"
Sep 09 23:23:35.914400 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:35.914331    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gnmpd_e43b611b-e005-461c-901f-6f06ecb41449/dns-node-resolver/0.log"
Sep 09 23:23:36.501023 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:36.500992    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ckxm8_02d28d58-fbd5-4fa7-acc5-8cb5890124ba/node-ca/0.log"
Sep 09 23:23:37.526847 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:37.526820    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-799c6f7f87-8d7rd_44619ef0-2867-4422-921b-c1742707cfe6/kube-auth-proxy/0.log"
Sep 09 23:23:37.623468 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:37.623438    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lm2wv_28719dc0-c39c-47eb-88a7-9e032c4e306d/payload-processing/0.log"
Sep 09 23:23:38.261927 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:38.261895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mghss_0e7b4df5-c5d9-4ed6-b387-f9493cadcfc7/serve-healthcheck-canary/0.log"
Sep 09 23:23:38.892825 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:38.892797    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szpql_351e420c-8f83-48f5-bef5-45fed469cd42/kube-rbac-proxy/0.log"
Sep 09 23:23:38.911272 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:38.911247    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szpql_351e420c-8f83-48f5-bef5-45fed469cd42/exporter/0.log"
Sep 09 23:23:38.930377 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:38.930342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szpql_351e420c-8f83-48f5-bef5-45fed469cd42/extractor/0.log"
Sep 09 23:23:40.887253 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:40.887221    2564 scope.go:117] "RemoveContainer" containerID="8b522789007b7946982309ed1f3361155fd90f65eaade7c628bc59b3f3e6a12f"
Sep 09 23:23:40.887619 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:40.887391    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz_llm(8adee587-8b46-4193-bd25-cb6dd42ef9fd)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-b9rgz" podUID="8adee587-8b46-4193-bd25-cb6dd42ef9fd"
Sep 09 23:23:41.003636 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:41.003603    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lxf7z_bc1116c4-b2b0-4fae-a0dd-bfde6ce6caa4/manager/0.log"
Sep 09 23:23:41.045652 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:41.045621    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-849b8bc99-nbtpc_6cc4b4a6-a6aa-40d2-831a-df55e13e68c6/manager/0.log"
Sep 09 23:23:41.238322 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:41.238291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-9f5vq_66c4ab31-1340-4305-98ba-d9d87a012f39/manager/0.log"
Sep 09 23:23:41.255676 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:41.255649    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d7ccb4-9f5vq_66c4ab31-1340-4305-98ba-d9d87a012f39/copy-manifests/0.log"
Sep 09 23:23:41.610970 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:41.610814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b8sjk/perf-node-gather-daemonset-5hnm6"
Sep 09 23:23:43.973029 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:43.973002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-799c6f7f87-8d7rd_44619ef0-2867-4422-921b-c1742707cfe6/kube-auth-proxy/0.log"
Sep 09 23:23:44.031568 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:44.031536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lm2wv_28719dc0-c39c-47eb-88a7-9e032c4e306d/payload-processing/0.log"
Sep 09 23:23:45.190799 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:45.190771    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-799c6f7f87-8d7rd_44619ef0-2867-4422-921b-c1742707cfe6/kube-auth-proxy/0.log"
Sep 09 23:23:45.257837 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:45.257792    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lm2wv_28719dc0-c39c-47eb-88a7-9e032c4e306d/payload-processing/0.log"
Sep 09 23:23:46.886641 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:46.886609    2564 scope.go:117] "RemoveContainer" containerID="5812a51fc9127ab63171003c162a12c59a4848268979cc5c03193a9d95d88b57"
Sep 09 23:23:46.887025 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:46.886666    2564 scope.go:117] "RemoveContainer" containerID="c5daaba45d06f1e2df43678eb3b57d850d7f78455962f92c59352b7e71fb7f98"
Sep 09 23:23:46.887025 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:46.886784    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb_llm(3821687d-3cb5-4b38-9ee1-bd3723f253ff)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-gk6kb" podUID="3821687d-3cb5-4b38-9ee1-bd3723f253ff"
Sep 09 23:23:46.887025 ip-10-0-143-254 kubenswrapper[2564]: E0909 23:23:46.886848    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-6z8r4_llm(8b01f437-f98e-4872-aa10-12f12d5d822c)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-6z8r4" podUID="8b01f437-f98e-4872-aa10-12f12d5d822c"
Sep 09 23:23:49.029643 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.029606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65d9z_623e0992-e247-4389-bccc-8727d736cce0/kube-multus/0.log"
Sep 09 23:23:49.377556 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.377474    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/kube-multus-additional-cni-plugins/0.log"
Sep 09 23:23:49.396114 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.396084    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/egress-router-binary-copy/0.log"
Sep 09 23:23:49.414004 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.413980    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/cni-plugins/0.log"
Sep 09 23:23:49.432911 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.432888    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/bond-cni-plugin/0.log"
Sep 09 23:23:49.451977 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.451951    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/routeoverride-cni/0.log"
Sep 09 23:23:49.471001 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.470972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/whereabouts-cni-bincopy/0.log"
Sep 09 23:23:49.490078 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.490053    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nt25c_2713c194-6d79-4c42-a0ed-6eac700bd135/whereabouts-cni/0.log"
Sep 09 23:23:49.583602 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.583564    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmp69_f88d163c-60ae-4403-9752-a1fd392b9b22/network-metrics-daemon/0.log"
Sep 09 23:23:49.602416 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:49.602389    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmp69_f88d163c-60ae-4403-9752-a1fd392b9b22/kube-rbac-proxy/0.log"
Sep 09 23:23:50.903328 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.903288    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/ovn-controller/0.log"
Sep 09 23:23:50.919029 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.919001    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/ovn-acl-logging/0.log"
Sep 09 23:23:50.941341 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.941308    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/kube-rbac-proxy-node/0.log"
Sep 09 23:23:50.960966 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.960940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 23:23:50.978014 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.977990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/northd/0.log"
Sep 09 23:23:50.998981 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:50.998956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/nbdb/0.log"
Sep 09 23:23:51.018694 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:51.018669    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/sbdb/0.log"
Sep 09 23:23:51.072581 ip-10-0-143-254 kubenswrapper[2564]: I0909 23:23:51.072550    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2w7r_5c734a93-79d9-4c96-8994-d728f489c4b3/ovnkube-controller/0.log"