Sep 10 04:26:03.952024 ip-10-0-137-116 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 04:26:04.380842 ip-10-0-137-116 kubenswrapper[2526]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:26:04.380842 ip-10-0-137-116 kubenswrapper[2526]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 04:26:04.380842 ip-10-0-137-116 kubenswrapper[2526]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:26:04.380842 ip-10-0-137-116 kubenswrapper[2526]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 04:26:04.380842 ip-10-0-137-116 kubenswrapper[2526]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 04:26:04.381538 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.380913    2526 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 04:26:04.384333 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384317    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.384333 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384334    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384338    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384342    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384347    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384351    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384354    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384357    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384360    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384363    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384365    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384368    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384371    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384373    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384376    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384378    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384381    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384384    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384387    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384390    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.384406 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384392    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384395    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384398    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384400    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384403    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384406    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384409    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384412    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384414    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384417    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384420    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384423    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384426    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384429    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384431    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384434    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384437    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384439    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384442    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.384886 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384445    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384447    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384450    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384452    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384454    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384457    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384459    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384462    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384464    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384467    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384469    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384472    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384475    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384477    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384479    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384483    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384487    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384489    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384492    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384494    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.385354 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384497    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384499    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384502    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384505    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384507    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384510    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384513    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384515    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384518    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384520    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384523    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384525    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384529    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384531    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384534    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384536    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384539    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384541    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384544    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384546    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.385852 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384549    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384552    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384555    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384558    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384560    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384563    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384566    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384569    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384572    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384575    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384577    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384580    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384583    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384585    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384588    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384590    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384593    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384595    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384598    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.384602    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.386384 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385320    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385327    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385331    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385334    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385337    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385340    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385343    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385345    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385348    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385351    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385354    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385357    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385360    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385363    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385365    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385368    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385371    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385374    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385379    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385383    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.386927 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385386    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385389    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385392    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385395    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385398    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385401    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385403    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385406    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385409    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385412    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385414    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385418    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385422    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385425    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385428    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385431    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385434    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385436    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385439    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.387472 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385441    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385444    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385447    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385450    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385453    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385456    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385458    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385461    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385464    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385466    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385469    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385472    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385474    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385477    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385480    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385482    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385485    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385488    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385490    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385493    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.387973 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385496    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385499    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385502    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385504    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385507    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385510    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385512    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385515    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385519    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385522    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385525    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385527    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385530    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385533    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385535    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385538    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385541    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385544    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385547    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.388563 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385549    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385552    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385554    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385558    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385561    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385564    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385567    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385569    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385572    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385575    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385577    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385580    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385583    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385586    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385589    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385591    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385594    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385597    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385599    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385602    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.389044 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.385605    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386008    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386013    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386016    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386019    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386022    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386025    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386027    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386030    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386034    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386037    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386039    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386042    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386044    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386047    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386050    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386053    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386056    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386058    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.389516 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386061    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386064    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386067    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386070    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386074    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386078    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386081    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386084    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386088    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386090    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386093    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386096    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386099    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386101    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386104    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386107    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386109    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386112    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386115    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.389991 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386117    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386120    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386123    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386125    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386131    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386133    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386136    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386138    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386141    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386144    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386149    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386155    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386158    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386161    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386165    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386168    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386172    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386175    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386178    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.390452 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386181    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386184    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386188    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386191    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386194    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386197    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386200    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386203    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386206    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386208    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386211    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386214    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386216    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386219    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386222    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386224    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386227    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386230    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386233    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.390956 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386235    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386238    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386240    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386244    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386246    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386250    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386253    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386256    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386258    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386261    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386263    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386266    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386269    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386272    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386274    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386277    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386279    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386282    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386284    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386287    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.391420 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386290    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386292    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386295    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.386298    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386367    2526 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386403    2526 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386409    2526 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386414    2526 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386418    2526 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386421    2526 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386425    2526 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386430    2526 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386434    2526 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386437    2526 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386441    2526 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386446    2526 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386449    2526 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386453    2526 flags.go:64] FLAG: --cgroup-root=""
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386456    2526 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386459    2526 flags.go:64] FLAG: --client-ca-file=""
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386462    2526 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386465    2526 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386470    2526 flags.go:64] FLAG: --cluster-domain=""
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386473    2526 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 04:26:04.391926 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386477    2526 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386480    2526 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386483    2526 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386487    2526 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386490    2526 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386493    2526 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386496    2526 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386499    2526 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386502    2526 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386505    2526 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386509    2526 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386512    2526 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386515    2526 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386518    2526 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386521    2526 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386524    2526 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386527    2526 flags.go:64] FLAG: --enable-server="true"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386530    2526 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386535    2526 flags.go:64] FLAG: --event-burst="100"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386538    2526 flags.go:64] FLAG: --event-qps="50"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386541    2526 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386544    2526 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386547    2526 flags.go:64] FLAG: --eviction-hard=""
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386552    2526 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 04:26:04.392537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386555    2526 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386560    2526 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386563    2526 flags.go:64] FLAG: --eviction-soft=""
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386566    2526 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386568    2526 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386571    2526 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386574    2526 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386577    2526 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386580    2526 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386583    2526 flags.go:64] FLAG: --feature-gates=""
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386587    2526 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386590    2526 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386593    2526 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386605    2526 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386608    2526 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386611    2526 flags.go:64] FLAG: --help="false"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386614    2526 flags.go:64] FLAG: --hostname-override="ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386618    2526 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386621    2526 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386623    2526 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386627    2526 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386630    2526 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386633    2526 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 04:26:04.393131 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386636    2526 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386639    2526 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386642    2526 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386645    2526 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386648    2526 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386651    2526 flags.go:64] FLAG: --kube-reserved=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386654    2526 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386658    2526 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386663    2526 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386665    2526 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386670    2526 flags.go:64] FLAG: --lock-file=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386672    2526 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386676    2526 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386679    2526 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386684    2526 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386688    2526 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386691    2526 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386693    2526 flags.go:64] FLAG: --logging-format="text"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386696    2526 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386699    2526 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386702    2526 flags.go:64] FLAG: --manifest-url=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386705    2526 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386710    2526 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386727    2526 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386731    2526 flags.go:64] FLAG: --max-pods="110"
Sep 10 04:26:04.393765 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386734    2526 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386738    2526 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386741    2526 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386744    2526 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386747    2526 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386750    2526 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386753    2526 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386760    2526 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386763    2526 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386766    2526 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386769    2526 flags.go:64] FLAG: --pod-cidr=""
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386772    2526 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386777    2526 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386780    2526 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386783    2526 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386787    2526 flags.go:64] FLAG: --port="10250"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386791    2526 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386795    2526 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e258dbd449981881"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386799    2526 flags.go:64] FLAG: --qos-reserved=""
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386802    2526 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386805    2526 flags.go:64] FLAG: --register-node="true"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386808    2526 flags.go:64] FLAG: --register-with-taints=""
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386811    2526 flags.go:64] FLAG: --registry-burst="10"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386814    2526 flags.go:64] FLAG: --registry-qps="5"
Sep 10 04:26:04.394405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386817    2526 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386820    2526 flags.go:64] FLAG: --reserved-memory=""
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386824    2526 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386827    2526 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386829    2526 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386832    2526 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386835    2526 flags.go:64] FLAG: --runonce="false"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386838    2526 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386841    2526 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386844    2526 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386847    2526 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386850    2526 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386853    2526 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386856    2526 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386859    2526 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386862    2526 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386865    2526 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386867    2526 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386870    2526 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386873    2526 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386876    2526 flags.go:64] FLAG: --system-cgroups=""
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386879    2526 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386884    2526 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386887    2526 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386896    2526 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 04:26:04.395080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386902    2526 flags.go:64] FLAG: --tls-min-version=""
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386905    2526 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386908    2526 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386911    2526 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386914    2526 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386917    2526 flags.go:64] FLAG: --v="2"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386921    2526 flags.go:64] FLAG: --version="false"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386925    2526 flags.go:64] FLAG: --vmodule=""
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386929    2526 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.386933    2526 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387051    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387055    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387058    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387062    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387065    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387068    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387071    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387073    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387076    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387080    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387082    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387085    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.395696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387087    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387090    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387093    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387096    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387098    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387101    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387104    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387106    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387109    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387113    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387121    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387124    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387126    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387129    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387132    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387134    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387137    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387139    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387142    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387145    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387147    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.396259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387150    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387153    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387155    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387159    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387163    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387166    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387168    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387171    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387174    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387176    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387179    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387182    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387186    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387189    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387192    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387195    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387198    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387200    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387203    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.396801 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387206    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387210    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387213    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387221    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387224    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387227    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387229    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387232    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387235    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387237    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387240    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387243    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387245    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387248    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387251    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387253    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387256    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387259    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387261    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387264    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.397243 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387267    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387269    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387272    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387275    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387279    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387283    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387286    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387289    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387291    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387294    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387297    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387300    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387302    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387306    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387309    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387312    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387320    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387323    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387325    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.397766 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387328    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387331    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387333    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387336    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387348    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387351    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387353    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.387356    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.388117    2526 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.395609    2526 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.395624    2526 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.396524    2526 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.396535    2526 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396594    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.398229 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396599    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396602    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396605    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396608    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396612    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396614    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396617    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396620    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396622    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396625    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396628    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396631    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396633    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396636    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396639    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396642    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396645    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396648    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396650    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.398566 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396653    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396656    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396659    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396661    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396664    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396667    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396683    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396686    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396689    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396692    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396695    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396698    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396701    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396703    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396706    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396709    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396711    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396727    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396731    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396735    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.399134 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396738    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396741    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396743    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396745    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396748    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396751    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396753    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396755    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396758    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396761    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396764    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396766    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396770    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396772    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396775    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396777    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396781    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396799    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396803    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396807    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.399622 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396811    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396815    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396818    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396821    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396824    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396827    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396829    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396832    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396835    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396838    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396840    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396843    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396846    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396848    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396850    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396853    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396855    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396858    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396861    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396863    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.400121 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396866    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396868    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396871    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396874    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396876    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396879    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396881    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396884    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396886    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396889    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396891    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396894    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396896    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396899    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396902    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396904    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396907    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396909    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.400587 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.396911    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.396916    2526 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397025    2526 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397029    2526 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397032    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397035    2526 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397039    2526 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397042    2526 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397045    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397048    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397051    2526 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397053    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397056    2526 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397058    2526 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 04:26:04.401023 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397060    2526 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397063    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397065    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397068    2526 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397071    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397073    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397076    2526 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397078    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397081    2526 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397084    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397086    2526 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397089    2526 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397091    2526 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397094    2526 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397096    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397100    2526 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397103    2526 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397106    2526 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397109    2526 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397112    2526 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 04:26:04.401394 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397115    2526 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397117    2526 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397121    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397123    2526 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397126    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397128    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397131    2526 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397133    2526 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397136    2526 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397140    2526 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397143    2526 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397145    2526 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397148    2526 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397151    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397153    2526 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397156    2526 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397159    2526 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397161    2526 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397164    2526 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 04:26:04.401908 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397167    2526 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397169    2526 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397171    2526 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397174    2526 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397177    2526 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397179    2526 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397183    2526 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397185    2526 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397187    2526 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397190    2526 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397193    2526 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397195    2526 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397198    2526 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397200    2526 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397203    2526 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397206    2526 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397208    2526 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397210    2526 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397213    2526 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 04:26:04.402372 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397215    2526 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397218    2526 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397221    2526 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397223    2526 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397226    2526 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397228    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397231    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397233    2526 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397236    2526 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397238    2526 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397241    2526 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397244    2526 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397247    2526 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397249    2526 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397252    2526 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397255    2526 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397257    2526 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397260    2526 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397262    2526 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397265    2526 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 04:26:04.402900 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397270    2526 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397273    2526 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397276    2526 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397278    2526 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397281    2526 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397283    2526 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397286    2526 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397288    2526 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:04.397290    2526 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.397295    2526 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.397396    2526 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.399803    2526 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.400920    2526 server.go:1019] "Starting client certificate rotation"
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.401020    2526 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 04:26:04.403376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.401060    2526 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 04:26:04.403781 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.403767    2526 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 04:26:04.407059 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.407012    2526 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 04:26:04.423849 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.423829    2526 log.go:25] "Validated CRI v1 runtime API"
Sep 10 04:26:04.427143 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.427127    2526 log.go:25] "Validated CRI v1 image API"
Sep 10 04:26:04.427968 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.427946    2526 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 04:26:04.433431 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.433407    2526 fs.go:135] Filesystem UUIDs: map[05135ed2-9146-490e-b368-6d006d34ccd9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c9b54326-91f2-4efe-9e84-27244931057a:/dev/nvme0n1p3]
Sep 10 04:26:04.433490 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.433431    2526 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 04:26:04.433995 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.433979    2526 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 04:26:04.438919 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.438801    2526 manager.go:216] Machine: {Timestamp:2026-09-10 04:26:04.437373215 +0000 UTC m=+0.378612132 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184705 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2efcd8bc9693cb67cc755409f0c9d1 SystemUUID:ec2efcd8-bc96-93cb-67cc-755409f0c9d1 BootID:8ed5ae61-60c0-4c7b-bb1b-b0fef952e07e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:7d:35:5d:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:7d:35:5d:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:a2:d9:41:74:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 04:26:04.438919 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.438912    2526 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 04:26:04.439040 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.438990    2526 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 04:26:04.442811 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.442784    2526 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 04:26:04.442973 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.442813    2526 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 04:26:04.443646 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.443637    2526 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 04:26:04.443685 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.443649    2526 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 04:26:04.443685 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.443658    2526 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 04:26:04.445262 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.445252    2526 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 04:26:04.446980 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.446970    2526 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 04:26:04.452406 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452395    2526 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 04:26:04.452522 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452513    2526 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 04:26:04.452558 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452543    2526 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 04:26:04.452558 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452557    2526 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 04:26:04.452634 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452592    2526 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 04:26:04.452634 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452603    2526 kubelet.go:398] "Adding apiserver pod source"
Sep 10 04:26:04.452634 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.452633    2526 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 04:26:04.453093 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.453081    2526 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 04:26:04.453191 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.453106    2526 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 04:26:04.455615 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.455591    2526 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 04:26:04.457859 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.457843    2526 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 04:26:04.457948 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.457881    2526 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 04:26:04.458774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458761    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458781    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458790    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458804    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458817    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458826    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 04:26:04.458848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458846    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 04:26:04.459048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458854    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 04:26:04.459048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458863    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 04:26:04.459048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458871    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 04:26:04.459048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458890    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 04:26:04.459048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.458898    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 04:26:04.459755 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.459744    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 04:26:04.459811 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.459757    2526 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 04:26:04.461655 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.461630    2526 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 04:26:04.461754 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.461691    2526 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 04:26:04.463656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.463640    2526 server.go:1268] "Started kubelet"
Sep 10 04:26:04.463778 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.463744    2526 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 04:26:04.463838 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.463799    2526 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 04:26:04.463878 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.463757    2526 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 04:26:04.464524 ip-10-0-137-116 systemd[1]: Started Kubernetes Kubelet.
Sep 10 04:26:04.465345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.465328    2526 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 04:26:04.470054 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.470030    2526 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 04:26:04.470519 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.470437    2526 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 04:26:04.473155 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.473137    2526 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 04:26:04.473466 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.473448    2526 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 04:26:04.473903 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.473886    2526 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 04:26:04.473983 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.473963    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.474584 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.474567    2526 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 04:26:04.474584 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.474585    2526 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 04:26:04.474764 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.474568    2526 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 04:26:04.474764 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.474733    2526 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 04:26:04.474764 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.474752    2526 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 04:26:04.474764 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.473503    2526 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-116.ec2.internal.18d3db15fbecc6b0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-116.ec2.internal,UID:ip-10-0-137-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-116.ec2.internal,},FirstTimestamp:2026-09-10 04:26:04.463613616 +0000 UTC m=+0.404852535,LastTimestamp:2026-09-10 04:26:04.463613616 +0000 UTC m=+0.404852535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-116.ec2.internal,}"
Sep 10 04:26:04.475152 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475139    2526 factory.go:153] Registering CRI-O factory
Sep 10 04:26:04.475213 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475178    2526 factory.go:223] Registration of the crio container factory successfully
Sep 10 04:26:04.475268 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475228    2526 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 04:26:04.475268 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475239    2526 factory.go:55] Registering systemd factory
Sep 10 04:26:04.475268 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475248    2526 factory.go:223] Registration of the systemd container factory successfully
Sep 10 04:26:04.475268 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475263    2526 factory.go:103] Registering Raw factory
Sep 10 04:26:04.475430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475276    2526 manager.go:1196] Started watching for new ooms in manager
Sep 10 04:26:04.475625 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.475613    2526 manager.go:349] Starting recovery of all containers
Sep 10 04:26:04.480037 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.480015    2526 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 04:26:04.480037 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.480016    2526 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 04:26:04.481001 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.480979    2526 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8j9z8"
Sep 10 04:26:04.486571 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.486438    2526 manager.go:354] Recovery completed
Sep 10 04:26:04.488068 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.488043    2526 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 10 04:26:04.488751 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.488699    2526 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8j9z8"
Sep 10 04:26:04.492526 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.492511    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.494770 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.494752    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.494835 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.494785    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.494835 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.494800    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.495394 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.495379    2526 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 04:26:04.495394 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.495392    2526 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 04:26:04.495513 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.495399    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.495513 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.495406    2526 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 04:26:04.496199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.496186    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.496256 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.496212    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.496256 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.496222    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.496738 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.496653    2526 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-116.ec2.internal.18d3db15fdc82975  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-116.ec2.internal,UID:ip-10-0-137-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-116.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-116.ec2.internal,},FirstTimestamp:2026-09-10 04:26:04.494768501 +0000 UTC m=+0.436007424,LastTimestamp:2026-09-10 04:26:04.494768501 +0000 UTC m=+0.436007424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-116.ec2.internal,}"
Sep 10 04:26:04.497429 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.497419    2526 policy_none.go:49] "None policy: Start"
Sep 10 04:26:04.497465 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.497433    2526 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 04:26:04.497465 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.497443    2526 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 04:26:04.499428 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.499413    2526 policy_none.go:47] "Start"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529208    2526 manager.go:337] "Starting Device Plugin manager"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.529239    2526 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529249    2526 server.go:87] "Starting device plugin registration server"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529581    2526 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529595    2526 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529692    2526 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529807    2526 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.529816    2526 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.530352    2526 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 04:26:04.549294 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.530410    2526 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.572587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.572555    2526 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 04:26:04.573723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.573698    2526 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 04:26:04.573788 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.573768    2526 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 04:26:04.573837 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.573794    2526 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 04:26:04.573880 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.573841    2526 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 04:26:04.575882 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.575858    2526 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:04.630602 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.630565    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.631642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.631563    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.631642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.631591    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.631642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.631602    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.631642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.631625    2526 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.637604 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.637589    2526 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.637669 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.637611    2526 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-116.ec2.internal\": node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.663034 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.663009    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.674129 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.674107    2526 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"]
Sep 10 04:26:04.674207 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.674178    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.675861 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.675846    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.675943 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.675875    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.675943 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.675886    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.678109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678098    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.678215 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678203    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.678256 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678229    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.678850 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678829    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.678850 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678838    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.678964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678854    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.678964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678860    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.678964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678867    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.678964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.678871    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.681048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.681031    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.681124 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.681058    2526 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 04:26:04.681778 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.681766    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 04:26:04.681833 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.681787    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 04:26:04.681833 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.681799    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeHasSufficientPID"
Sep 10 04:26:04.698231 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.698214    2526 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-116.ec2.internal\" not found" node="ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.701498 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.701484    2526 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-116.ec2.internal\" not found" node="ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.763644 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.763621    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.775677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.775653    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.775783 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.775679    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.864244 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.864201    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.876552 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.876532    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.876615 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.876555    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.876615 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.876576    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccd2cc3e7932d8aeb13e227945612366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-116.ec2.internal\" (UID: \"ccd2cc3e7932d8aeb13e227945612366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.876690 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.876638    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.876743 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.876699    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c65f865ccaac893fc85febd000a5ed7d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal\" (UID: \"c65f865ccaac893fc85febd000a5ed7d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.965042 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:04.964964    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:04.977325 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.977301    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccd2cc3e7932d8aeb13e227945612366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-116.ec2.internal\" (UID: \"ccd2cc3e7932d8aeb13e227945612366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:04.977383 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:04.977350    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccd2cc3e7932d8aeb13e227945612366-config\") pod \"kube-apiserver-proxy-ip-10-0-137-116.ec2.internal\" (UID: \"ccd2cc3e7932d8aeb13e227945612366\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:05.001468 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:05.001431    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:05.004607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:05.004592    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:05.065485 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:05.065455    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:06.889281 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:06.889251    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:06.989866 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:06.989786    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.004322 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.004297    2526 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:07.090078 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:07.090050    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.123503 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.123477    2526 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 04:26:07.123946 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.123614    2526 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 04:26:07.123946 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.123625    2526 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 04:26:07.190910 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:07.190884    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.215442 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.215412    2526 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 04:21:06 +0000 UTC" deadline="2028-02-28 18:26:35.794676718 +0000 UTC"
Sep 10 04:26:07.215442 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.215439    2526 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12878h0m28.579241031s"
Sep 10 04:26:07.230663 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.230643    2526 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:07.291579 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:07.291514    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.392550 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:07.392521    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.493087 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:07.493055    2526 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-116.ec2.internal\" not found"
Sep 10 04:26:07.512103 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:07.512068    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc65f865ccaac893fc85febd000a5ed7d.slice/crio-cccc802e4f1c0dcc0ab69cd440e034dddae01ef40d6e9d1b5c321fa2226c4244 WatchSource:0}: Error finding container cccc802e4f1c0dcc0ab69cd440e034dddae01ef40d6e9d1b5c321fa2226c4244: Status 404 returned error can't find the container with id cccc802e4f1c0dcc0ab69cd440e034dddae01ef40d6e9d1b5c321fa2226c4244
Sep 10 04:26:07.512467 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:07.512446    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd2cc3e7932d8aeb13e227945612366.slice/crio-d9eb404ef633f53ecd1e52cdfa6ae08a83f4933fe25c15afdd3dcc2750cee8f5 WatchSource:0}: Error finding container d9eb404ef633f53ecd1e52cdfa6ae08a83f4933fe25c15afdd3dcc2750cee8f5: Status 404 returned error can't find the container with id d9eb404ef633f53ecd1e52cdfa6ae08a83f4933fe25c15afdd3dcc2750cee8f5
Sep 10 04:26:07.515807 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.515792    2526 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:26:07.552140 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.552059    2526 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:07.597893 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.597865    2526 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:07.610251 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.610232    2526 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 04:26:07.611176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.611163    2526 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal"
Sep 10 04:26:07.616787 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:07.616774    2526 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 04:26:08.177412 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.177379    2526 apiserver.go:52] "Watching apiserver"
Sep 10 04:26:08.186666 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.186637    2526 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 04:26:08.187199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.187169    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-5cvdw","openshift-network-diagnostics/network-check-target-9cd9j","openshift-network-operator/iptables-alerter-dl2xv","openshift-ovn-kubernetes/ovnkube-node-pt4pq","kube-system/konnectivity-agent-cj9gf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg","openshift-dns/node-resolver-pf2s7","openshift-image-registry/node-ca-nj585","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal","openshift-multus/multus-additional-cni-plugins-4rm6n","openshift-multus/network-metrics-daemon-84mxk","kube-system/global-pull-secret-syncer-x6fvh","kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pqrsn"]
Sep 10 04:26:08.189714 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.189692    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.191883 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.191865    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.192031 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.191944    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:08.192178 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.192153    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-57klp\""
Sep 10 04:26:08.192286 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.192203    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.192286 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.192164    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.194182 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.194159    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.196380 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.196359    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.196474 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.196405    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 04:26:08.196816 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.196663    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.197585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.196820    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gr6mf\""
Sep 10 04:26:08.197585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.196923    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.197585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.197388    2526 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 04:26:08.199000 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.198846    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 04:26:08.199084 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199030    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwnp5\""
Sep 10 04:26:08.199274 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199254    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.199347 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199299    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.199526 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199506    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 04:26:08.199922 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199906    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 04:26:08.200008 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199952    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 04:26:08.200008 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.199975    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.201269 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.201249    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 04:26:08.201703 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.201685    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cr4dg\""
Sep 10 04:26:08.201703 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.201702    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.201848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.201747    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 04:26:08.203991 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.203974    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.204261 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.204225    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.204434 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.204406    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 04:26:08.204606 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.204582    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kh7zf\""
Sep 10 04:26:08.204954 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.204922    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.206430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.206410    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.207004 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.206828    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.207229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207183    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-iptables-alerter-script\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.207229 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207215    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-systemd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207239    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207260    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-env-overrides\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207283    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mk88\" (UniqueName: \"kubernetes.io/projected/52bbea76-3846-46f4-9d9b-1fc303da8083-kube-api-access-9mk88\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207308    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszvr\" (UniqueName: \"kubernetes.io/projected/49799fb0-faa9-433b-8f94-a9873983ffda-kube-api-access-tszvr\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207327    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jc52b\""
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207330    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-kubelet\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207352    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-slash\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207387 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207373    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-bin\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207397    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-script-lib\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207420    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqj2w\" (UniqueName: \"kubernetes.io/projected/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-kube-api-access-vqj2w\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207458    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-config\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207463    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207505    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-agent-certs\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207526    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a52f818-b30f-44fb-982c-6a206dbb8dd7-tmp-dir\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207579    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6dg\" (UniqueName: \"kubernetes.io/projected/9a52f818-b30f-44fb-982c-6a206dbb8dd7-kube-api-access-qb6dg\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207603    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-var-lib-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207626    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-netd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207649    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207707    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-konnectivity-ca\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207745    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a52f818-b30f-44fb-982c-6a206dbb8dd7-hosts-file\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207767    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.207774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207781    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-systemd-units\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207829    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-host-slash\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207860    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-node-log\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207882    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207905    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-netns\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207943    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-log-socket\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207965    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52bbea76-3846-46f4-9d9b-1fc303da8083-ovn-node-metrics-cert\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.207993    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-etc-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.208014    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-ovn\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.208414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.208213    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 04:26:08.208907 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.208454    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.208907 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.208614    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.208907 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.208754    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pvnt7\""
Sep 10 04:26:08.209069 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.209002    2526 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 04:26:08.210187 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.210091    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:08.210187 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.210153    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:08.212769 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.212750    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.215061 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.215029    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pgljq\""
Sep 10 04:26:08.215558 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.215429    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 04:26:08.215558 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.215460    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 04:26:08.215798 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.215637    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 04:26:08.216078 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.216058    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 04:26:08.218422 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.217895    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 04:26:08.220112 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.220092    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.222586 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.222561    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 04:26:08.222777 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.222759    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.222895 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.222875    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:08.223725 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.223623    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7l8xk\""
Sep 10 04:26:08.230833 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.230809    2526 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ht6k"
Sep 10 04:26:08.238411 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.238147    2526 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8ht6k"
Sep 10 04:26:08.299546 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.299468    2526 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 04:26:08.305479 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.305421    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal" event={"ID":"ccd2cc3e7932d8aeb13e227945612366","Type":"ContainerStarted","Data":"d9eb404ef633f53ecd1e52cdfa6ae08a83f4933fe25c15afdd3dcc2750cee8f5"}
Sep 10 04:26:08.307346 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.307315    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal" event={"ID":"c65f865ccaac893fc85febd000a5ed7d","Type":"ContainerStarted","Data":"cccc802e4f1c0dcc0ab69cd440e034dddae01ef40d6e9d1b5c321fa2226c4244"}
Sep 10 04:26:08.308296 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308273    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.308395 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308304    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-modprobe-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.308395 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308349    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.308395 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308376    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-cni-binary-copy\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308413    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-kubelet\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308437    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-slash\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308465    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-sys\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308485    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-tmp\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308501    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-kubelet\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.308553 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308508    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-kubernetes\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308589    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-slash\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308623    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-lib-modules\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308658    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a52f818-b30f-44fb-982c-6a206dbb8dd7-tmp-dir\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308684    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-konnectivity-ca\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308708    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fef90e3-41fe-47ea-be33-937fa28a2427-host\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308753    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-cnibin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308781    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-bin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.308830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308808    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-daemon-config\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308835    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a52f818-b30f-44fb-982c-6a206dbb8dd7-hosts-file\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308962    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.308988    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-systemd-units\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309024    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309048    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-systemd\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309073    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-host-slash\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309098    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-node-log\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309186    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-host-slash\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.309216 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309217    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309241    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-netns\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309256    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-node-log\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309273    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9a52f818-b30f-44fb-982c-6a206dbb8dd7-hosts-file\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309265    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309336    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-var-lib-kubelet\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309338    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-netns\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309361    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-host\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309383    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fef90e3-41fe-47ea-be33-937fa28a2427-serviceca\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.309407    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309409    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-kubelet-config\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.309472    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:08.809454959 +0000 UTC m=+3.027481592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309541    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-systemd-units\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309587    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.309662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309648    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309684    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-etc-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309713    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-ovn\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309734    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309759    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309767    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-ovn\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309784    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-multus\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309816    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-conf-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309804    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-etc-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309837    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-konnectivity-ca\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309846    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-multus-certs\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309875    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-etc-kubernetes\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309895    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-iptables-alerter-script\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309911    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-systemd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309941    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mk88\" (UniqueName: \"kubernetes.io/projected/52bbea76-3846-46f4-9d9b-1fc303da8083-kube-api-access-9mk88\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309964    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-dbus\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309971    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-systemd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.310344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.309987    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-cnibin\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310013    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-k8s-cni-cncf-io\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310055    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc2f6\" (UniqueName: \"kubernetes.io/projected/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-kube-api-access-dc2f6\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310094    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszvr\" (UniqueName: \"kubernetes.io/projected/49799fb0-faa9-433b-8f94-a9873983ffda-kube-api-access-tszvr\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310122    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-bin\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310144    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-script-lib\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310162    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a52f818-b30f-44fb-982c-6a206dbb8dd7-tmp-dir\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310170    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-device-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310191    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310222    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqj2w\" (UniqueName: \"kubernetes.io/projected/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-kube-api-access-vqj2w\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310249    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-config\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310305    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-agent-certs\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310359    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310403    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-system-cni-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310428    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-system-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310457    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-iptables-alerter-script\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310473    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6dg\" (UniqueName: \"kubernetes.io/projected/9a52f818-b30f-44fb-982c-6a206dbb8dd7-kube-api-access-qb6dg\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.311136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310511    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-var-lib-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310555    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-bin\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310633    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-var-lib-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310665    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-netd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310689    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310727    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtscp\" (UniqueName: \"kubernetes.io/projected/6fef90e3-41fe-47ea-be33-937fa28a2427-kube-api-access-rtscp\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310769    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310850    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-cni-netd\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310915    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-kubelet\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.310993    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-run\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311037    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311036    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-script-lib\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311078    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311112    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8jz\" (UniqueName: \"kubernetes.io/projected/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kube-api-access-2l8jz\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311157    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-run-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311181    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-conf\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311205    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-tuned\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.311791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311224    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-ovnkube-config\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311233    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvktq\" (UniqueName: \"kubernetes.io/projected/c0827b42-4689-44cc-b80b-ba4d580107eb-kube-api-access-bvktq\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311256    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311259    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-socket-dir-parent\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311204    2526 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311289    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-log-socket\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311316    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52bbea76-3846-46f4-9d9b-1fc303da8083-ovn-node-metrics-cert\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311339    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/581446c7-957c-451d-b279-b7e53ac6dd6d-kube-api-access-snq7t\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311367    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-log-socket\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311373    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysconfig\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311396    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-netns\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311416    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-hostroot\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311451    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311474    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-env-overrides\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311558    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/52bbea76-3846-46f4-9d9b-1fc303da8083-run-openvswitch\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.312570 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.311840    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/52bbea76-3846-46f4-9d9b-1fc303da8083-env-overrides\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.316291 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.316268    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5748ab3-c029-4f6a-a6ce-95d33d0ebc78-agent-certs\") pod \"konnectivity-agent-cj9gf\" (UID: \"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78\") " pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.317677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.317504    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/52bbea76-3846-46f4-9d9b-1fc303da8083-ovn-node-metrics-cert\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.325659 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.325632    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszvr\" (UniqueName: \"kubernetes.io/projected/49799fb0-faa9-433b-8f94-a9873983ffda-kube-api-access-tszvr\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.326087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.326052    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqj2w\" (UniqueName: \"kubernetes.io/projected/d8cb37c5-ee76-47a4-b609-9de10ab9ce2a-kube-api-access-vqj2w\") pod \"iptables-alerter-dl2xv\" (UID: \"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a\") " pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.327447 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.327425    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6dg\" (UniqueName: \"kubernetes.io/projected/9a52f818-b30f-44fb-982c-6a206dbb8dd7-kube-api-access-qb6dg\") pod \"node-resolver-pf2s7\" (UID: \"9a52f818-b30f-44fb-982c-6a206dbb8dd7\") " pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.327967 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.327588    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mk88\" (UniqueName: \"kubernetes.io/projected/52bbea76-3846-46f4-9d9b-1fc303da8083-kube-api-access-9mk88\") pod \"ovnkube-node-pt4pq\" (UID: \"52bbea76-3846-46f4-9d9b-1fc303da8083\") " pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.376940 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.376894    2526 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:08.412591 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412556    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412600    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-system-cni-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412625    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-system-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412650    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtscp\" (UniqueName: \"kubernetes.io/projected/6fef90e3-41fe-47ea-be33-937fa28a2427-kube-api-access-rtscp\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412678    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412702    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-kubelet\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412727    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-run\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412748    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.412774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412771    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8jz\" (UniqueName: \"kubernetes.io/projected/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kube-api-access-2l8jz\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412782    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-system-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412794    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-conf\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412817    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-tuned\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412830    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-kubelet\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412839    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvktq\" (UniqueName: \"kubernetes.io/projected/c0827b42-4689-44cc-b80b-ba4d580107eb-kube-api-access-bvktq\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412865    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-socket-dir-parent\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412890    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/581446c7-957c-451d-b279-b7e53ac6dd6d-kube-api-access-snq7t\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412912    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysconfig\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412947    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-netns\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412969    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-hostroot\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412994    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.412676    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-system-cni-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413017    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-modprobe-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413051    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413057    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413076    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-cni-binary-copy\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.413174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413101    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-sys\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413122    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-tmp\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413144    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-kubernetes\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413167    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-lib-modules\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413190    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fef90e3-41fe-47ea-be33-937fa28a2427-host\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413212    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-cnibin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413234    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-bin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413257    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-daemon-config\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413282    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-conf\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413294    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413345    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-run\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413354    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413408    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-socket-dir-parent\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413412    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-cni-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413464    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-sys\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413603    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fef90e3-41fe-47ea-be33-937fa28a2427-host\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413650    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-bin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413672    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-kubernetes\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413679    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysconfig\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413716    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-cnibin\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413735    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-netns\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413776    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-lib-modules\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413780    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-hostroot\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413881    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-modprobe-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.413959    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-registration-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414307    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-daemon-config\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414389    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414424    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/581446c7-957c-451d-b279-b7e53ac6dd6d-cni-binary-copy\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414431    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-systemd\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414488    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414499    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-systemd\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414514    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414543    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-var-lib-kubelet\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414565    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-host\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414589    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fef90e3-41fe-47ea-be33-937fa28a2427-serviceca\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414607    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-sysctl-d\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.414911 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414614    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-kubelet-config\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414638    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414658    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-var-lib-kubelet\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414704    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-host\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414780    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414661    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414825    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414852    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414878    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-multus\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414902    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-conf-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414942    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-multus-certs\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414968    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-etc-kubernetes\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.414994    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-dbus\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415017    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-cnibin\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415052    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-k8s-cni-cncf-io\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415078    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc2f6\" (UniqueName: \"kubernetes.io/projected/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-kube-api-access-dc2f6\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415106    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-device-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.415766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415107    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fef90e3-41fe-47ea-be33-937fa28a2427-serviceca\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415129    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415168    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-kubelet-config\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415202    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-sys-fs\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415304    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-etc-kubernetes\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415330    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-var-lib-cni-multus\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415340    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-multus-conf-dir\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415377    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-multus-certs\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415416    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/581446c7-957c-451d-b279-b7e53ac6dd6d-host-run-k8s-cni-cncf-io\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415456    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-socket-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.415519    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.416006    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:08.915989323 +0000 UTC m=+3.134015953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415582    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415591    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0827b42-4689-44cc-b80b-ba4d580107eb-cnibin\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415626    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-device-dir\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415859    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-tmp\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415892    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0827b42-4689-44cc-b80b-ba4d580107eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.416587 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.415561    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68819b9e-ee1e-47c2-b8a5-ce1857439665-dbus\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.417166 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.416361    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-etc-tuned\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.418466 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.418442    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:08.418466 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.418466    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:08.418715 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.418479    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:08.418715 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.418550    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:08.918532239 +0000 UTC m=+3.136558867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:08.421086 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.421063    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtscp\" (UniqueName: \"kubernetes.io/projected/6fef90e3-41fe-47ea-be33-937fa28a2427-kube-api-access-rtscp\") pod \"node-ca-nj585\" (UID: \"6fef90e3-41fe-47ea-be33-937fa28a2427\") " pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.421293 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.421269    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8jz\" (UniqueName: \"kubernetes.io/projected/0d295368-f4c9-4fd7-a358-3a67e24b2e1d-kube-api-access-2l8jz\") pod \"aws-ebs-csi-driver-node-z2xpg\" (UID: \"0d295368-f4c9-4fd7-a358-3a67e24b2e1d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.421967 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.421946    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvktq\" (UniqueName: \"kubernetes.io/projected/c0827b42-4689-44cc-b80b-ba4d580107eb-kube-api-access-bvktq\") pod \"multus-additional-cni-plugins-4rm6n\" (UID: \"c0827b42-4689-44cc-b80b-ba4d580107eb\") " pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.422823 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.422803    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snq7t\" (UniqueName: \"kubernetes.io/projected/581446c7-957c-451d-b279-b7e53ac6dd6d-kube-api-access-snq7t\") pod \"multus-5cvdw\" (UID: \"581446c7-957c-451d-b279-b7e53ac6dd6d\") " pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.428782 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.428707    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc2f6\" (UniqueName: \"kubernetes.io/projected/d3978ce1-1b53-4d8c-818b-3b7251f3bb6f-kube-api-access-dc2f6\") pod \"tuned-pqrsn\" (UID: \"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f\") " pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.503423 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.503390    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pf2s7"
Sep 10 04:26:08.513371 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.512802    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dl2xv"
Sep 10 04:26:08.517158 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:08.517128    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a52f818_b30f_44fb_982c_6a206dbb8dd7.slice/crio-defbdb07b4fbcf0c3ed1f6be29d65dbac3c63620e74ebf12a6f7acce193f05d3 WatchSource:0}: Error finding container defbdb07b4fbcf0c3ed1f6be29d65dbac3c63620e74ebf12a6f7acce193f05d3: Status 404 returned error can't find the container with id defbdb07b4fbcf0c3ed1f6be29d65dbac3c63620e74ebf12a6f7acce193f05d3
Sep 10 04:26:08.523444 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:08.523420    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8cb37c5_ee76_47a4_b609_9de10ab9ce2a.slice/crio-5e20d1b028ffbac15eac593f0a8515ed70fa9d04f5a4668ac62117a6dfee174d WatchSource:0}: Error finding container 5e20d1b028ffbac15eac593f0a8515ed70fa9d04f5a4668ac62117a6dfee174d: Status 404 returned error can't find the container with id 5e20d1b028ffbac15eac593f0a8515ed70fa9d04f5a4668ac62117a6dfee174d
Sep 10 04:26:08.526876 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.526853    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:08.536401 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.536372    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:08.536942 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:08.536907    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bbea76_3846_46f4_9d9b_1fc303da8083.slice/crio-d8bd053e0f0ab774fd86ebad6a57de140210d61eea961a22845941b292dabfa5 WatchSource:0}: Error finding container d8bd053e0f0ab774fd86ebad6a57de140210d61eea961a22845941b292dabfa5: Status 404 returned error can't find the container with id d8bd053e0f0ab774fd86ebad6a57de140210d61eea961a22845941b292dabfa5
Sep 10 04:26:08.544650 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.544632    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg"
Sep 10 04:26:08.545034 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:08.545011    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5748ab3_c029_4f6a_a6ce_95d33d0ebc78.slice/crio-1d29c496ddb73557d7acd4d51fca5b4d432ed5554cc609d507c1a7588312273d WatchSource:0}: Error finding container 1d29c496ddb73557d7acd4d51fca5b4d432ed5554cc609d507c1a7588312273d: Status 404 returned error can't find the container with id 1d29c496ddb73557d7acd4d51fca5b4d432ed5554cc609d507c1a7588312273d
Sep 10 04:26:08.551724 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.551703    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqrsn"
Sep 10 04:26:08.561576 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.561554    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nj585"
Sep 10 04:26:08.569296 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.569278    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4rm6n"
Sep 10 04:26:08.577044 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.577022    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5cvdw"
Sep 10 04:26:08.817336 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.817262    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:08.817492 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.817422    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:08.817492 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.817482    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:09.817464728 +0000 UTC m=+4.035491356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:08.918010 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:08.917977    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:08.918150 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.918134    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:08.918201 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:08.918191    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:09.918178352 +0000 UTC m=+4.136204979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:09.019067 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.019034    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:09.019251 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.019231    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:09.019299 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.019262    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:09.019299 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.019288    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:09.019390 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.019354    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:10.019335051 +0000 UTC m=+4.237361685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:09.242677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.242588    2526 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:08 +0000 UTC" deadline="2028-05-13 11:18:52.169254891 +0000 UTC"
Sep 10 04:26:09.242677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.242628    2526 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14670h52m42.926631895s"
Sep 10 04:26:09.310891 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.310852    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cj9gf" event={"ID":"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78","Type":"ContainerStarted","Data":"1d29c496ddb73557d7acd4d51fca5b4d432ed5554cc609d507c1a7588312273d"}
Sep 10 04:26:09.312410 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.312382    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"d8bd053e0f0ab774fd86ebad6a57de140210d61eea961a22845941b292dabfa5"}
Sep 10 04:26:09.314292 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.314265    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dl2xv" event={"ID":"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a","Type":"ContainerStarted","Data":"5e20d1b028ffbac15eac593f0a8515ed70fa9d04f5a4668ac62117a6dfee174d"}
Sep 10 04:26:09.315620 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.315598    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pf2s7" event={"ID":"9a52f818-b30f-44fb-982c-6a206dbb8dd7","Type":"ContainerStarted","Data":"defbdb07b4fbcf0c3ed1f6be29d65dbac3c63620e74ebf12a6f7acce193f05d3"}
Sep 10 04:26:09.685218 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:09.685187    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3978ce1_1b53_4d8c_818b_3b7251f3bb6f.slice/crio-2a9316b597fbc7a07d02d27cfb6c725b53d22872bc4f553882e29e774e6f2918 WatchSource:0}: Error finding container 2a9316b597fbc7a07d02d27cfb6c725b53d22872bc4f553882e29e774e6f2918: Status 404 returned error can't find the container with id 2a9316b597fbc7a07d02d27cfb6c725b53d22872bc4f553882e29e774e6f2918
Sep 10 04:26:09.688060 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:09.688033    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d295368_f4c9_4fd7_a358_3a67e24b2e1d.slice/crio-ef068a8ae3b654da2a65248b3b6592e0430488e46ccbf8760093824662d33bfe WatchSource:0}: Error finding container ef068a8ae3b654da2a65248b3b6592e0430488e46ccbf8760093824662d33bfe: Status 404 returned error can't find the container with id ef068a8ae3b654da2a65248b3b6592e0430488e46ccbf8760093824662d33bfe
Sep 10 04:26:09.689358 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:09.689276    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fef90e3_41fe_47ea_be33_937fa28a2427.slice/crio-d8b7b0264251fd4dabdfc6df54194beb77b55b5c1ea9c70fe024672782886437 WatchSource:0}: Error finding container d8b7b0264251fd4dabdfc6df54194beb77b55b5c1ea9c70fe024672782886437: Status 404 returned error can't find the container with id d8b7b0264251fd4dabdfc6df54194beb77b55b5c1ea9c70fe024672782886437
Sep 10 04:26:09.690047 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:09.689656    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0827b42_4689_44cc_b80b_ba4d580107eb.slice/crio-741e9fad70c7c007b2efe8002ef787eb5792b91a3207c9388bd73dff00f721f3 WatchSource:0}: Error finding container 741e9fad70c7c007b2efe8002ef787eb5792b91a3207c9388bd73dff00f721f3: Status 404 returned error can't find the container with id 741e9fad70c7c007b2efe8002ef787eb5792b91a3207c9388bd73dff00f721f3
Sep 10 04:26:09.691789 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:09.691738    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581446c7_957c_451d_b279_b7e53ac6dd6d.slice/crio-8a6e76e001a33b0bd9f29539e17fbd3cb19f50dfecc91377cd37fba0c51c64c2 WatchSource:0}: Error finding container 8a6e76e001a33b0bd9f29539e17fbd3cb19f50dfecc91377cd37fba0c51c64c2: Status 404 returned error can't find the container with id 8a6e76e001a33b0bd9f29539e17fbd3cb19f50dfecc91377cd37fba0c51c64c2
Sep 10 04:26:09.825299 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.825264    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:09.825440 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.825388    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:09.825507 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.825471    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:11.825451859 +0000 UTC m=+6.043478502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:09.926573 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:09.926095    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:09.926573 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.926206    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:09.926573 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:09.926253    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:11.926241186 +0000 UTC m=+6.144267814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:10.026987 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.026953    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:10.027180 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.027164    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:10.027252 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.027187    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:10.027252 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.027200    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:10.027356 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.027256    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:12.027239377 +0000 UTC m=+6.245266009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:10.242875 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.242777    2526 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 04:21:08 +0000 UTC" deadline="2028-04-10 18:57:42.745934263 +0000 UTC"
Sep 10 04:26:10.242875 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.242821    2526 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13886h31m32.503117608s"
Sep 10 04:26:10.270811 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.270780    2526 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 04:26:10.300087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.300057    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:10.300245 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.300187    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:10.300600 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.300576    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:10.300704 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.300667    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:10.300766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.300728    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:10.300822 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:10.300800    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:10.321243 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.321209    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerStarted","Data":"741e9fad70c7c007b2efe8002ef787eb5792b91a3207c9388bd73dff00f721f3"}
Sep 10 04:26:10.323674 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.323646    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5cvdw" event={"ID":"581446c7-957c-451d-b279-b7e53ac6dd6d","Type":"ContainerStarted","Data":"8a6e76e001a33b0bd9f29539e17fbd3cb19f50dfecc91377cd37fba0c51c64c2"}
Sep 10 04:26:10.326416 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.326357    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqrsn" event={"ID":"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f","Type":"ContainerStarted","Data":"2a9316b597fbc7a07d02d27cfb6c725b53d22872bc4f553882e29e774e6f2918"}
Sep 10 04:26:10.329194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.329136    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal" event={"ID":"ccd2cc3e7932d8aeb13e227945612366","Type":"ContainerStarted","Data":"3141a084fe9fa2b9e13285074b171a36f383bdee74ceeb71f64a729a80c6edac"}
Sep 10 04:26:10.333735 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.333214    2526 generic.go:356] "Generic (PLEG): container finished" podID="c65f865ccaac893fc85febd000a5ed7d" containerID="9bb2f7fcb7d4168e6513008963180d43b988a5afb339c84deda3e576bda2587c" exitCode=0
Sep 10 04:26:10.333735 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.333290    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal" event={"ID":"c65f865ccaac893fc85febd000a5ed7d","Type":"ContainerDied","Data":"9bb2f7fcb7d4168e6513008963180d43b988a5afb339c84deda3e576bda2587c"}
Sep 10 04:26:10.336453 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.336428    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg" event={"ID":"0d295368-f4c9-4fd7-a358-3a67e24b2e1d","Type":"ContainerStarted","Data":"ef068a8ae3b654da2a65248b3b6592e0430488e46ccbf8760093824662d33bfe"}
Sep 10 04:26:10.338001 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.337979    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nj585" event={"ID":"6fef90e3-41fe-47ea-be33-937fa28a2427","Type":"ContainerStarted","Data":"d8b7b0264251fd4dabdfc6df54194beb77b55b5c1ea9c70fe024672782886437"}
Sep 10 04:26:10.344493 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:10.344441    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-116.ec2.internal" podStartSLOduration=3.3444246140000002 podStartE2EDuration="3.344424614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:10.344200826 +0000 UTC m=+4.562227498" watchObservedRunningTime="2026-09-10 04:26:10.344424614 +0000 UTC m=+4.562451280"
Sep 10 04:26:11.843719 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:11.843118    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:11.843719 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:11.843284    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:11.843719 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:11.843344    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:15.843327153 +0000 UTC m=+10.061353797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:11.943839 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:11.943796    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:11.944029 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:11.944008    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:11.944092 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:11.944072    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:15.944054171 +0000 UTC m=+10.162080817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:12.044389 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:12.044354    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:12.044565 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.044549    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:12.044636 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.044572    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:12.044636 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.044584    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:12.044736 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.044640    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:16.044624056 +0000 UTC m=+10.262650687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:12.297562 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:12.297482    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:12.297708 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.297619    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:12.298027 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:12.298000    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:12.298144 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.298102    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:12.298289 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:12.298262    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:12.298372 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:12.298348    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:14.297547 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:14.297515    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:14.298051 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:14.297624    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:14.298051 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:14.297728    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:14.298051 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:14.297521    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:14.298051 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:14.297626    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:14.298051 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:14.297898    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:15.879491 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:15.879458    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:15.879880 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:15.879568    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:15.879880 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:15.879623    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:23.87961049 +0000 UTC m=+18.097637118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:15.980425 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:15.980389    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:15.980582 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:15.980571    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:15.980649 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:15.980632    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:23.980613473 +0000 UTC m=+18.198640105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:16.081149 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:16.081108    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:16.081333 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.081301    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:16.081333 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.081323    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:16.081438 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.081337    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:16.081438 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.081412    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:24.081385799 +0000 UTC m=+18.299412445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:16.298968    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:16.298998    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:16.299007    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.299117    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.299259    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:16.299431 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:16.299348    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:18.298154 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:18.298122    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:18.298613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:18.298229    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:18.298613 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:18.298261    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:18.298613 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:18.298338    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:18.298613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:18.298122    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:18.298613 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:18.298451    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:20.298143 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:20.298103    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:20.298627 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:20.298104    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:20.298627 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:20.298214    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:20.298627 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:20.298320    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:20.298627 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:20.298111    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:20.298627 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:20.298408    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:22.298025 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:22.297991    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:22.298468 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:22.297991    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:22.298468 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:22.298120    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:22.298468 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:22.297991    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:22.298468 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:22.298220    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:22.298468 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:22.298254    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:23.939530 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:23.939499    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:23.940063 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:23.939669    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:23.940063 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:23.939737    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:26:39.939718574 +0000 UTC m=+34.157745202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:24.040640 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:24.040585    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:24.040791 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.040724    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:24.040791 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.040790    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:40.040775908 +0000 UTC m=+34.258802536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:24.141727 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:24.141686    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:24.141894 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.141831    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:24.141894 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.141850    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:24.141894 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.141862    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:24.142081 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.141951    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:26:40.141917977 +0000 UTC m=+34.359944606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:24.298407 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:24.298373    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:24.298566 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:24.298423    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:24.298566 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:24.298384    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:24.298566 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.298508    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:24.298702 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.298618    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:24.298738 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:24.298705    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:26.298581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.298245    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:26.299260 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.298340    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:26.299260 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:26.298662    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:26.299260 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.298392    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:26.299260 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:26.298739    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:26.299260 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:26.298782    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:26.371072 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.371037    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal" event={"ID":"c65f865ccaac893fc85febd000a5ed7d","Type":"ContainerStarted","Data":"1133e80671740c26b8e4dda00bee00ecc95b877648c9e4767bfbdd8ab5bf8874"}
Sep 10 04:26:26.372577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.372545    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pf2s7" event={"ID":"9a52f818-b30f-44fb-982c-6a206dbb8dd7","Type":"ContainerStarted","Data":"8003ec7e9224f618057c27bdd9b091d13cc608174e6c0804d99eec898f15d9d8"}
Sep 10 04:26:26.374109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.374081    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg" event={"ID":"0d295368-f4c9-4fd7-a358-3a67e24b2e1d","Type":"ContainerStarted","Data":"e85d09b03e0e92a5207195cd898311b2352d9a79c8dda68da5c3e941f4797cd6"}
Sep 10 04:26:26.375534 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.375516    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nj585" event={"ID":"6fef90e3-41fe-47ea-be33-937fa28a2427","Type":"ContainerStarted","Data":"7ab3b1239ca0c27add84f718309668ea305d006936e43cfe6afcb38072d58001"}
Sep 10 04:26:26.376821 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.376800    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cj9gf" event={"ID":"a5748ab3-c029-4f6a-a6ce-95d33d0ebc78","Type":"ContainerStarted","Data":"161cb5647140ceca0ed4b24d91fc77b8746a01ef9a325b2d1639da86a0890d06"}
Sep 10 04:26:26.379608 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379587    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"c85ffe65d50f112262400d1967439d3438afe576179af492e9e1311d765f6cfb"}
Sep 10 04:26:26.379712 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379644    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"4ebbb1e71e5a73cb413801ca6fe00561407a2ea25acd9e8d6e5cb81b89365eb4"}
Sep 10 04:26:26.379712 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379680    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"ddbd82f2e868b20fb5fe0c51fdcba9741171b178fe9f90f6ccdf34344ecbfa11"}
Sep 10 04:26:26.379804 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379719    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"9d4a8c5b2436c5f3f00ba60c0d39dce72ce972801fd6f22ddb1676b09e19eae6"}
Sep 10 04:26:26.379804 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379753    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"8dfd01bdab37cd0c47ebe8d17c5df94138ec89d91afe42b328b4a5855c865717"}
Sep 10 04:26:26.379804 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.379785    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"bbf7dd7e320f0b78fa7892f7429fb3f38f64d3dd35b0f7074467a3545bfa1197"}
Sep 10 04:26:26.380996 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.380974    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="879d8cc4d0fc534e76f9d2abb8c5d8f5b918c738fde78caafe7b907eeae34ad8" exitCode=0
Sep 10 04:26:26.381073 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.381052    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"879d8cc4d0fc534e76f9d2abb8c5d8f5b918c738fde78caafe7b907eeae34ad8"}
Sep 10 04:26:26.382498 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.382435    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5cvdw" event={"ID":"581446c7-957c-451d-b279-b7e53ac6dd6d","Type":"ContainerStarted","Data":"df9bd6ed4fd7e315b114d36753c909d1aef271cc9b5a795a4de24a2bd8102514"}
Sep 10 04:26:26.383890 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.383874    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqrsn" event={"ID":"d3978ce1-1b53-4d8c-818b-3b7251f3bb6f","Type":"ContainerStarted","Data":"85d0adffab4acd95066d792918702da87853a6f6d2560726299be6c0ecda864d"}
Sep 10 04:26:26.389616 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.389581    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-116.ec2.internal" podStartSLOduration=19.389570369 podStartE2EDuration="19.389570369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.389148227 +0000 UTC m=+20.607174876" watchObservedRunningTime="2026-09-10 04:26:26.389570369 +0000 UTC m=+20.607597018"
Sep 10 04:26:26.403185 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.403147    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cj9gf" podStartSLOduration=10.998752846 podStartE2EDuration="20.403136079s" totalImagesPullingTime="9.404383233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.402961768 +0000 UTC m=+20.620988409" watchObservedRunningTime="2026-09-10 04:26:26.403136079 +0000 UTC m=+20.621162728"
Sep 10 04:26:26.438424 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.438377    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5cvdw" podStartSLOduration=4.314591518 podStartE2EDuration="20.438361508s" totalImagesPullingTime="16.12376999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.438225126 +0000 UTC m=+20.656251776" watchObservedRunningTime="2026-09-10 04:26:26.438361508 +0000 UTC m=+20.656388158"
Sep 10 04:26:26.453792 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.453745    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pf2s7" podStartSLOduration=15.664336167 podStartE2EDuration="20.453730138s" totalImagesPullingTime="4.789393971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.453325899 +0000 UTC m=+20.671352575" watchObservedRunningTime="2026-09-10 04:26:26.453730138 +0000 UTC m=+20.671756788"
Sep 10 04:26:26.470149 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.469739    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pqrsn" podStartSLOduration=4.407738868 podStartE2EDuration="20.469719584s" totalImagesPullingTime="16.061980716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.46880387 +0000 UTC m=+20.686830533" watchObservedRunningTime="2026-09-10 04:26:26.469719584 +0000 UTC m=+20.687746235"
Sep 10 04:26:26.483248 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:26.483207    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nj585" podStartSLOduration=4.668745252 podStartE2EDuration="20.483177488s" totalImagesPullingTime="15.814432236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:26.482526365 +0000 UTC m=+20.700553014" watchObservedRunningTime="2026-09-10 04:26:26.483177488 +0000 UTC m=+20.701204137"
Sep 10 04:26:27.075303 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.075093    2526 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 04:26:27.265360 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.265196    2526 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T04:26:27.075300274Z","UUID":"92c501df-2ef8-4ac6-9572-cede17616e64","Handler":null,"Name":"","Endpoint":""}
Sep 10 04:26:27.266744 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.266724    2526 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 04:26:27.266844 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.266760    2526 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 04:26:27.388485 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.388446    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dl2xv" event={"ID":"d8cb37c5-ee76-47a4-b609-9de10ab9ce2a","Type":"ContainerStarted","Data":"54c2a0c81c0c897f8b8ac6342e1dbca17b28bc89a8f4ba61d76adcc098cc733a"}
Sep 10 04:26:27.390647 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:27.390615    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg" event={"ID":"0d295368-f4c9-4fd7-a358-3a67e24b2e1d","Type":"ContainerStarted","Data":"6f1357eebc72c1238f1f66d0b18bab0791d788aa116a87b59b4da3f2f0604c84"}
Sep 10 04:26:28.297900 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:28.297873    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:28.297900 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:28.297886    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:28.298095 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:28.297991    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:28.298095 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:28.297996    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:28.298183 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:28.298087    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:28.298183 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:28.298174    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:29.399012 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.398972    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"c5cde565affadc5691f2401de643b2aa0232fff73f34b27930f361e87ddc3bde"}
Sep 10 04:26:29.401218 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.401192    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg" event={"ID":"0d295368-f4c9-4fd7-a358-3a67e24b2e1d","Type":"ContainerStarted","Data":"ee39bbb89ead80dc08037adc4d789c709526b20b75ed7cb1dfa92f2efc1ff9ed"}
Sep 10 04:26:29.415734 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.415709    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:29.416273 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.416253    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:29.418627 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.418591    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2xpg" podStartSLOduration=9.188500507 podStartE2EDuration="23.418578826s" totalImagesPullingTime="14.230078319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:29.418359744 +0000 UTC m=+23.636386394" watchObservedRunningTime="2026-09-10 04:26:29.418578826 +0000 UTC m=+23.636605476"
Sep 10 04:26:29.419074 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:29.419050    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dl2xv" podStartSLOduration=17.745936776 podStartE2EDuration="23.419043159s" totalImagesPullingTime="5.673106383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:27.402392625 +0000 UTC m=+21.620419274" watchObservedRunningTime="2026-09-10 04:26:29.419043159 +0000 UTC m=+23.637069809"
Sep 10 04:26:30.297754 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:30.297723    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:30.298063 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:30.297723    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:30.298063 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:30.297854    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:30.298063 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:30.297728    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:30.298063 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:30.297922    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:30.298063 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:30.297997    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:30.404294 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:30.404225    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:30.404791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:30.404772    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cj9gf"
Sep 10 04:26:31.410842 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:31.410528    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" event={"ID":"52bbea76-3846-46f4-9d9b-1fc303da8083","Type":"ContainerStarted","Data":"adb74c2f4790ed4b38d8b17e40ea5fae710f720d438b6468d6ee7264907445db"}
Sep 10 04:26:31.437019 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:31.436962    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq" podStartSLOduration=8.139393033 podStartE2EDuration="25.436939992s" totalImagesPullingTime="17.297546959s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:31.436736556 +0000 UTC m=+25.654763206" watchObservedRunningTime="2026-09-10 04:26:31.436939992 +0000 UTC m=+25.654966651"
Sep 10 04:26:32.297738 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.297700    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:32.297964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.297706    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:32.297964 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.297859    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:32.297964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.297708    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:32.297964 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.297951    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:32.298179 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.298001    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:32.391401 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.391372    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6fvh"]
Sep 10 04:26:32.395005 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.394978    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9cd9j"]
Sep 10 04:26:32.395734 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.395663    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84mxk"]
Sep 10 04:26:32.412823 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.412795    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:32.412823 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.412795    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:32.413496 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.412911    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:32.413496 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.413367    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:32.413613 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.413507    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:32.413664 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:32.413608    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:32.413664 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.413639    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:32.413754 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.413704    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:32.413815 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.413769    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:32.429545 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.429524    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:32.430548 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:32.430528    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:26:33.416390 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:33.416358    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="07cdaeccf544545fe777441e06f17129cb280c6f4fdaad703b4022a82637cd03" exitCode=0
Sep 10 04:26:33.416989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:33.416391    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"07cdaeccf544545fe777441e06f17129cb280c6f4fdaad703b4022a82637cd03"}
Sep 10 04:26:34.297997 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:34.297968    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:34.298183 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:34.297968    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:34.298183 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:34.298061    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:34.298183 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:34.298156    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:34.298183 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:34.297980    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:34.298340 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:34.298273    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:35.423000 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:35.422729    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="45a6fcf2b19b4797f7ae7c5b16077dab2a6aa5ee293e0cdaa9c57dfdcc1b3a02" exitCode=0
Sep 10 04:26:35.423425 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:35.422819    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"45a6fcf2b19b4797f7ae7c5b16077dab2a6aa5ee293e0cdaa9c57dfdcc1b3a02"}
Sep 10 04:26:36.298871 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:36.298834    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:36.299076 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:36.298963    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:36.299076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:36.298974    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:36.299076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:36.298992    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:36.299076 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:36.299061    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:36.299252 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:36.299134    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:37.430483 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:37.430444    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="6275f2b15cf678d12731ca60b2f43b2bd6dbfbdf89ba18fdbee0f513d9aa88d0" exitCode=0
Sep 10 04:26:37.430916 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:37.430508    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"6275f2b15cf678d12731ca60b2f43b2bd6dbfbdf89ba18fdbee0f513d9aa88d0"}
Sep 10 04:26:38.297545 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.297512    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:38.297711 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.297512    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:38.297711 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.297511    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:38.297711 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.297698    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9cd9j" podUID="f3935ba8-636e-474c-b7cc-22854fed158a"
Sep 10 04:26:38.297846 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.297760    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x6fvh" podUID="68819b9e-ee1e-47c2-b8a5-ce1857439665"
Sep 10 04:26:38.297891 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.297865    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84mxk" podUID="49799fb0-faa9-433b-8f94-a9873983ffda"
Sep 10 04:26:38.549950 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.549860    2526 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-116.ec2.internal" event="NodeReady"
Sep 10 04:26:38.550280 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.550006    2526 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 04:26:38.583821 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.583789    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"]
Sep 10 04:26:38.587176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.587159    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.588808 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.588779    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"]
Sep 10 04:26:38.591430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.591410    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"]
Sep 10 04:26:38.591567 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.591546    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.593462 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.593427    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 04:26:38.593554 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.593427    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 04:26:38.594289 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594261    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 04:26:38.594494 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594466    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:26:38.594837 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594656    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 04:26:38.594837 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594674    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 04:26:38.595048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594741    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 04:26:38.595048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.594267    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 04:26:38.595142 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.595130    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.595714 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.595689    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 04:26:38.598309 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.598292    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 04:26:38.598983 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.598960    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-l7nqd\""
Sep 10 04:26:38.599118 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.599096    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.601508 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.601487    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"]
Sep 10 04:26:38.601696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.601681    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 04:26:38.601979 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.601847    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 04:26:38.602108 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.602022    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 04:26:38.602268 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.602251    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgv6k\""
Sep 10 04:26:38.607394 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.607373    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 04:26:38.610278 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.610259    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"]
Sep 10 04:26:38.610786 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.610764    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-74ctt"]
Sep 10 04:26:38.613898 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.613878    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.616117 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.616098    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\""
Sep 10 04:26:38.616449 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.616429    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 04:26:38.616638 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.616623    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 04:26:38.616723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.616652    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"]
Sep 10 04:26:38.617370 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.617348    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xr4vn"]
Sep 10 04:26:38.622501 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.621752    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.623324 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.623303    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74ctt"]
Sep 10 04:26:38.625521 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.625498    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 04:26:38.625669 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.625649    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-228jb\""
Sep 10 04:26:38.625734 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.625665    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 04:26:38.625807 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.625566    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 04:26:38.626780 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.626761    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:26:38.633407 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.633386    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xr4vn"]
Sep 10 04:26:38.746677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746626    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f699d85-e299-4d69-b096-0046fe2de72a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.746677 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746677    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4qm6\" (UniqueName: \"kubernetes.io/projected/9f699d85-e299-4d69-b096-0046fe2de72a-kube-api-access-w4qm6\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.746905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746705    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c137659f-99ea-43d6-90e5-361c0dc6ad36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.746905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746726    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.746905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746816    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9k4\" (UniqueName: \"kubernetes.io/projected/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-kube-api-access-5x9k4\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.746905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746855    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8f2\" (UniqueName: \"kubernetes.io/projected/9d98d7d6-96a4-4237-b749-a89bd1adfa88-kube-api-access-gw8f2\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746904    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746950    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746977    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72v7p\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.746996    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747035    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747061    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747099    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d98d7d6-96a4-4237-b749-a89bd1adfa88-config-volume\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747113    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l62l\" (UniqueName: \"kubernetes.io/projected/c137659f-99ea-43d6-90e5-361c0dc6ad36-kube-api-access-5l62l\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747132    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747152    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ee1535-780c-4acc-bf45-99c65481c462-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747186    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d98d7d6-96a4-4237-b749-a89bd1adfa88-tmp-dir\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747203    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747226    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747247    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f699d85-e299-4d69-b096-0046fe2de72a-tmp\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.747342 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747260    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747357    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.747613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747400    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.747613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747443    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkmhd\" (UniqueName: \"kubernetes.io/projected/a0ee1535-780c-4acc-bf45-99c65481c462-kube-api-access-rkmhd\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.747613 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.747475    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-cert\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.769126 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.769079    2526 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cj9gf_a5748ab3-c029-4f6a-a6ce-95d33d0ebc78/konnectivity-agent/0.log" limit=1024
Sep 10 04:26:38.848186 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848108    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.848186 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848146    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ee1535-780c-4acc-bf45-99c65481c462-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.848383 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848186    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d98d7d6-96a4-4237-b749-a89bd1adfa88-tmp-dir\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.848383 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848212    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.848383 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848352    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.848528 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848500    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f699d85-e299-4d69-b096-0046fe2de72a-tmp\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.848578 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848538    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d98d7d6-96a4-4237-b749-a89bd1adfa88-tmp-dir\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.848578 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848559    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.848679 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848635    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.848679 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848669    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.848774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848736    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkmhd\" (UniqueName: \"kubernetes.io/projected/a0ee1535-780c-4acc-bf45-99c65481c462-kube-api-access-rkmhd\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.848815 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848776    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-cert\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.848815 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848802    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f699d85-e299-4d69-b096-0046fe2de72a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.848906 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848827    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4qm6\" (UniqueName: \"kubernetes.io/projected/9f699d85-e299-4d69-b096-0046fe2de72a-kube-api-access-w4qm6\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.848906 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848852    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c137659f-99ea-43d6-90e5-361c0dc6ad36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.848906 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848877    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.848906 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848896    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f699d85-e299-4d69-b096-0046fe2de72a-tmp\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848907    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9k4\" (UniqueName: \"kubernetes.io/projected/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-kube-api-access-5x9k4\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848946    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8f2\" (UniqueName: \"kubernetes.io/projected/9d98d7d6-96a4-4237-b749-a89bd1adfa88-kube-api-access-gw8f2\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848975    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.848998    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849024    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0ee1535-780c-4acc-bf45-99c65481c462-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849048    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72v7p\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849069    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.849111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849080    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849121    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849146    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849178    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d98d7d6-96a4-4237-b749-a89bd1adfa88-config-volume\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.849202    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l62l\" (UniqueName: \"kubernetes.io/projected/c137659f-99ea-43d6-90e5-361c0dc6ad36-kube-api-access-5l62l\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.849229    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:38.849417 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.849303    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:39.3492824 +0000 UTC m=+33.567309047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:38.850388 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.849887    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:38.850388 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.849905    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:38.850388 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:38.850003    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:39.349986855 +0000 UTC m=+33.568013503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:26:38.850646 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.850623    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.851149 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.851071    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.851385 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.851359    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9d98d7d6-96a4-4237-b749-a89bd1adfa88-config-volume\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.853621 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.853598    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-ca\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.853719 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.853629    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.853719 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.853658    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.853852 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.853745    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.854337 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.854095    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9f699d85-e299-4d69-b096-0046fe2de72a-klusterlet-config\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.854337 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.854219    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c137659f-99ea-43d6-90e5-361c0dc6ad36-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.854337 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.854299    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a0ee1535-780c-4acc-bf45-99c65481c462-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.854565 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.854534    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-cert\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.854821 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.854805    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.857890 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.857845    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.858139 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.858118    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9k4\" (UniqueName: \"kubernetes.io/projected/d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2-kube-api-access-5x9k4\") pod \"ingress-canary-xr4vn\" (UID: \"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2\") " pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:38.858327 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.858289    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4qm6\" (UniqueName: \"kubernetes.io/projected/9f699d85-e299-4d69-b096-0046fe2de72a-kube-api-access-w4qm6\") pod \"klusterlet-addon-workmgr-b7cbd7bd-pfcgk\" (UID: \"9f699d85-e299-4d69-b096-0046fe2de72a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.858831 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.858811    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8f2\" (UniqueName: \"kubernetes.io/projected/9d98d7d6-96a4-4237-b749-a89bd1adfa88-kube-api-access-gw8f2\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:38.859069 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.859053    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l62l\" (UniqueName: \"kubernetes.io/projected/c137659f-99ea-43d6-90e5-361c0dc6ad36-kube-api-access-5l62l\") pod \"managed-serviceaccount-addon-agent-57896fdb88-k9mzp\" (UID: \"c137659f-99ea-43d6-90e5-361c0dc6ad36\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.860100 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.860079    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72v7p\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:38.860263 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.860249    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkmhd\" (UniqueName: \"kubernetes.io/projected/a0ee1535-780c-4acc-bf45-99c65481c462-kube-api-access-rkmhd\") pod \"cluster-proxy-proxy-agent-6fbddb66b8-tzc5g\" (UID: \"a0ee1535-780c-4acc-bf45-99c65481c462\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.869280 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.869165    2526 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cj9gf_a5748ab3-c029-4f6a-a6ce-95d33d0ebc78/konnectivity-agent/0.log" limit=1024
Sep 10 04:26:38.912328 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.912297    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:26:38.920450 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.920425    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:38.929595 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.929568    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"
Sep 10 04:26:38.954009 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:38.953987    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xr4vn"
Sep 10 04:26:39.242725 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.242656    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp"]
Sep 10 04:26:39.246867 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.246844    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"]
Sep 10 04:26:39.247241 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:39.247204    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc137659f_99ea_43d6_90e5_361c0dc6ad36.slice/crio-934c98848db712d0c6e53d13b413ac24ce7c2cef713513813b4667fa112b856f WatchSource:0}: Error finding container 934c98848db712d0c6e53d13b413ac24ce7c2cef713513813b4667fa112b856f: Status 404 returned error can't find the container with id 934c98848db712d0c6e53d13b413ac24ce7c2cef713513813b4667fa112b856f
Sep 10 04:26:39.247995 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.247974    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"]
Sep 10 04:26:39.249483 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:39.249464    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0ee1535_780c_4acc_bf45_99c65481c462.slice/crio-e985553acf2ff1524a36bedda8fa9e6bbb43acaf050d495868bd1e4f8afea041 WatchSource:0}: Error finding container e985553acf2ff1524a36bedda8fa9e6bbb43acaf050d495868bd1e4f8afea041: Status 404 returned error can't find the container with id e985553acf2ff1524a36bedda8fa9e6bbb43acaf050d495868bd1e4f8afea041
Sep 10 04:26:39.250104 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:39.250081    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f699d85_e299_4d69_b096_0046fe2de72a.slice/crio-c0485216d974c54639965e91bf0cf26f758e14507a24761a79487bf320108d0b WatchSource:0}: Error finding container c0485216d974c54639965e91bf0cf26f758e14507a24761a79487bf320108d0b: Status 404 returned error can't find the container with id c0485216d974c54639965e91bf0cf26f758e14507a24761a79487bf320108d0b
Sep 10 04:26:39.277998 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.277972    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xr4vn"]
Sep 10 04:26:39.281671 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:26:39.281594    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd84ec46c_caa3_40d4_adc9_3a4bbb4dd1e2.slice/crio-cb7090dfcfb43b209fbf5382ea531b22a8592f77072c62feb2961f62c3db48e9 WatchSource:0}: Error finding container cb7090dfcfb43b209fbf5382ea531b22a8592f77072c62feb2961f62c3db48e9: Status 404 returned error can't find the container with id cb7090dfcfb43b209fbf5382ea531b22a8592f77072c62feb2961f62c3db48e9
Sep 10 04:26:39.353321 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.353284    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:39.353462 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.353427    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:39.353462 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.353425    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:39.353462 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.353462    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:39.353565 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.353508    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:40.353494815 +0000 UTC m=+34.571521443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:26:39.353602 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.353560    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:39.353631 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.353612    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:40.353598576 +0000 UTC m=+34.571625204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:39.437025 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.436973    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp" event={"ID":"c137659f-99ea-43d6-90e5-361c0dc6ad36","Type":"ContainerStarted","Data":"934c98848db712d0c6e53d13b413ac24ce7c2cef713513813b4667fa112b856f"}
Sep 10 04:26:39.438297 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.438268    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xr4vn" event={"ID":"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2","Type":"ContainerStarted","Data":"cb7090dfcfb43b209fbf5382ea531b22a8592f77072c62feb2961f62c3db48e9"}
Sep 10 04:26:39.439548 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.439514    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerStarted","Data":"e985553acf2ff1524a36bedda8fa9e6bbb43acaf050d495868bd1e4f8afea041"}
Sep 10 04:26:39.440710 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.440690    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk" event={"ID":"9f699d85-e299-4d69-b096-0046fe2de72a","Type":"ContainerStarted","Data":"c0485216d974c54639965e91bf0cf26f758e14507a24761a79487bf320108d0b"}
Sep 10 04:26:39.958142 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:39.958098    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:39.958848 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.958254    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:39.958848 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:39.958319    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:27:11.958301032 +0000 UTC m=+66.176327677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 04:26:40.058981 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.058924    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:40.059194 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.059173    2526 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:40.059268 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.059249    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret podName:68819b9e-ee1e-47c2-b8a5-ce1857439665 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:12.05923101 +0000 UTC m=+66.277257643 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret") pod "global-pull-secret-syncer-x6fvh" (UID: "68819b9e-ee1e-47c2-b8a5-ce1857439665") : object "kube-system"/"original-pull-secret" not registered
Sep 10 04:26:40.160657 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.160034    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:40.160657 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.160217    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 04:26:40.160657 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.160243    2526 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 04:26:40.160657 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.160255    2526 projected.go:196] Error preparing data for projected volume kube-api-access-csnnt for pod openshift-network-diagnostics/network-check-target-9cd9j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:40.160657 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.160312    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt podName:f3935ba8-636e-474c-b7cc-22854fed158a nodeName:}" failed. No retries permitted until 2026-09-10 04:27:12.160295252 +0000 UTC m=+66.378321882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-csnnt" (UniqueName: "kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt") pod "network-check-target-9cd9j" (UID: "f3935ba8-636e-474c-b7cc-22854fed158a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 04:26:40.307733 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.305772    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:26:40.307733 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.306229    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:26:40.307733 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.306613    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:26:40.309435 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.309103    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 04:26:40.309435 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.309292    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 04:26:40.310809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.309842    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\""
Sep 10 04:26:40.310809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.310094    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\""
Sep 10 04:26:40.310809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.310313    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 04:26:40.310809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.310503    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 04:26:40.365341 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.364821    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:40.365341 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:40.364887    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:40.365341 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.365034    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:40.365341 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.365048    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:40.365341 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.365105    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:42.36508512 +0000 UTC m=+36.583111961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:26:40.377986 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.366157    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:40.377986 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:40.366245    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:42.366203774 +0000 UTC m=+36.584230421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:42.385603 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:42.385554    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:42.385664    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:42.385848    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:42.385921    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:46.385904642 +0000 UTC m=+40.603931290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:42.386005    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:42.386016    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:42.386210 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:42.386054    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:46.38604168 +0000 UTC m=+40.604068309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:26:46.425155 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:46.425117    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:46.425217    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:46.425291    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:46.425309    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:46.425313    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:46.425377    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:54.425359946 +0000 UTC m=+48.643386586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:46.425623 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:46.425393    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:26:54.425385715 +0000 UTC m=+48.643412343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:26:50.478522 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.478491    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xr4vn" event={"ID":"d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2","Type":"ContainerStarted","Data":"60e4c707816a4163146611f8d300f3afb5f970ff45cdf7ad50109c8817f69887"}
Sep 10 04:26:50.480067 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.480040    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerStarted","Data":"e252b58def1d0affadd2c1e89d21c2c7ae8b0b276061a9ceea3998dd64a39488"}
Sep 10 04:26:50.481511 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.481486    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk" event={"ID":"9f699d85-e299-4d69-b096-0046fe2de72a","Type":"ContainerStarted","Data":"13c1a5d5c3da10ebca0457fb39e6212c53ebc89f119a10436e2d52be52ac10a9"}
Sep 10 04:26:50.484757 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.484731    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerStarted","Data":"dbb54b0d6fd282d1ebb7a74c834bfcf79295b220d2cf1169df82de3f0fba3a64"}
Sep 10 04:26:50.486238 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.486218    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp" event={"ID":"c137659f-99ea-43d6-90e5-361c0dc6ad36","Type":"ContainerStarted","Data":"b9584b5b32f71a0a4915bb38517565ae497746a7842630f716a29f91d03c9ed2"}
Sep 10 04:26:50.492295 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.492058    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:50.493752 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.493733    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk"
Sep 10 04:26:50.508239 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.508183    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b7cbd7bd-pfcgk" podStartSLOduration=14.542556311 podStartE2EDuration="25.508162381s" totalImagesPullingTime="10.96560607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:50.506923405 +0000 UTC m=+44.724950068" watchObservedRunningTime="2026-09-10 04:26:50.508162381 +0000 UTC m=+44.726189032"
Sep 10 04:26:50.540863 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.540793    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xr4vn" podStartSLOduration=1.6065200389999998 podStartE2EDuration="12.540772457s" totalImagesPullingTime="10.934252418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:50.540710371 +0000 UTC m=+44.758737034" watchObservedRunningTime="2026-09-10 04:26:50.540772457 +0000 UTC m=+44.758799108"
Sep 10 04:26:50.555582 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:50.555339    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57896fdb88-k9mzp" podStartSLOduration=14.587610391 podStartE2EDuration="25.555304194s" totalImagesPullingTime="10.967693803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:50.554066073 +0000 UTC m=+44.772092724" watchObservedRunningTime="2026-09-10 04:26:50.555304194 +0000 UTC m=+44.773330846"
Sep 10 04:26:51.491740 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:51.491702    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="dbb54b0d6fd282d1ebb7a74c834bfcf79295b220d2cf1169df82de3f0fba3a64" exitCode=0
Sep 10 04:26:51.492214 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:51.491783    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"dbb54b0d6fd282d1ebb7a74c834bfcf79295b220d2cf1169df82de3f0fba3a64"}
Sep 10 04:26:51.494101 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:51.494067    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerStarted","Data":"5f311ab2e0dce1d7d4566dfcc644c7ff4f1854c76427ef2cbc1aa8e5e4d7b516"}
Sep 10 04:26:51.494192 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:51.494117    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerStarted","Data":"63ff1f24a91c5d1941712f640bb5dd7b3f5f279c06c85dc506b94a181063c522"}
Sep 10 04:26:51.527755 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:51.527698    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" podStartSLOduration=15.545941695 podStartE2EDuration="26.527679633s" totalImagesPullingTime="10.981737938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:51.526992341 +0000 UTC m=+45.745018991" watchObservedRunningTime="2026-09-10 04:26:51.527679633 +0000 UTC m=+45.745706281"
Sep 10 04:26:52.499770 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:52.499737    2526 generic.go:356] "Generic (PLEG): container finished" podID="c0827b42-4689-44cc-b80b-ba4d580107eb" containerID="445bb4446c090fc1da63beceaf53f11c949cdd48062f901cab7e431158c29fbc" exitCode=0
Sep 10 04:26:52.500174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:52.499812    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerDied","Data":"445bb4446c090fc1da63beceaf53f11c949cdd48062f901cab7e431158c29fbc"}
Sep 10 04:26:53.508760 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:53.508706    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" event={"ID":"c0827b42-4689-44cc-b80b-ba4d580107eb","Type":"ContainerStarted","Data":"2563471c4f8a1b464ceb858761f6196d3de5734893356cc7176c9a08ee25f3e7"}
Sep 10 04:26:53.528835 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:53.528784    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4rm6n" podStartSLOduration=10.502477861 podStartE2EDuration="47.52876551s" totalImagesPullingTime="37.026287649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:26:53.527347482 +0000 UTC m=+47.745374132" watchObservedRunningTime="2026-09-10 04:26:53.52876551 +0000 UTC m=+47.746792160"
Sep 10 04:26:54.492096 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:54.492050    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:26:54.492274 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:26:54.492111    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:26:54.492274 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:54.492206    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:26:54.492274 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:54.492274    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:10.492258745 +0000 UTC m=+64.710285373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:26:54.492397 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:54.492209    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:26:54.492397 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:54.492311    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:26:54.492397 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:26:54.492357    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:10.492346087 +0000 UTC m=+64.710372714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:27:04.429336 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:04.429303    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pt4pq"
Sep 10 04:27:10.513757 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:10.513717    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:10.513792    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:10.513964    2526 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:10.513981    2526 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:10.514000    2526 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fcb6fb458-5xrtw: secret "image-registry-tls" not found
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:10.514016    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls podName:9d98d7d6-96a4-4237-b749-a89bd1adfa88 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:42.514002686 +0000 UTC m=+96.732029313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls") pod "dns-default-74ctt" (UID: "9d98d7d6-96a4-4237-b749-a89bd1adfa88") : secret "dns-default-metrics-tls" not found
Sep 10 04:27:10.514232 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:10.514097    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls podName:884277b3-7f47-4165-adb0-b6d6da2ba3a6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:42.514084514 +0000 UTC m=+96.732111147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls") pod "image-registry-5fcb6fb458-5xrtw" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6") : secret "image-registry-tls" not found
Sep 10 04:27:12.026694 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.026643    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:27:12.030197 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.030179    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 04:27:12.036889 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:12.036872    2526 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 04:27:12.036960 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:12.036949    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs podName:49799fb0-faa9-433b-8f94-a9873983ffda nodeName:}" failed. No retries permitted until 2026-09-10 04:28:16.03691985 +0000 UTC m=+130.254946490 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs") pod "network-metrics-daemon-84mxk" (UID: "49799fb0-faa9-433b-8f94-a9873983ffda") : secret "metrics-daemon-secret" not found
Sep 10 04:27:12.127950 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.127895    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:27:12.130142 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.130123    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 04:27:12.141641 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.141609    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68819b9e-ee1e-47c2-b8a5-ce1857439665-original-pull-secret\") pod \"global-pull-secret-syncer-x6fvh\" (UID: \"68819b9e-ee1e-47c2-b8a5-ce1857439665\") " pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:27:12.229224 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.229184    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:27:12.231664 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.231645    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 04:27:12.241195 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.241173    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 04:27:12.252161 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.252141    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csnnt\" (UniqueName: \"kubernetes.io/projected/f3935ba8-636e-474c-b7cc-22854fed158a-kube-api-access-csnnt\") pod \"network-check-target-9cd9j\" (UID: \"f3935ba8-636e-474c-b7cc-22854fed158a\") " pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:27:12.425794 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.425761    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p9c7m\""
Sep 10 04:27:12.431993 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.431970    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x6fvh"
Sep 10 04:27:12.434054 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.434034    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:27:12.707417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.707346    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x6fvh"]
Sep 10 04:27:12.710361 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:12.710335    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9cd9j"]
Sep 10 04:27:12.711168 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:27:12.711125    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68819b9e_ee1e_47c2_b8a5_ce1857439665.slice/crio-74687e25c57cb0527833f0bc655f96ef7eb0cf77522ad07f94056ab097cdc9d7 WatchSource:0}: Error finding container 74687e25c57cb0527833f0bc655f96ef7eb0cf77522ad07f94056ab097cdc9d7: Status 404 returned error can't find the container with id 74687e25c57cb0527833f0bc655f96ef7eb0cf77522ad07f94056ab097cdc9d7
Sep 10 04:27:12.713975 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:27:12.713915    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3935ba8_636e_474c_b7cc_22854fed158a.slice/crio-3f1ab072bd30102535f455e12d6405168020311fa6c064207e2dc7cb398de0d4 WatchSource:0}: Error finding container 3f1ab072bd30102535f455e12d6405168020311fa6c064207e2dc7cb398de0d4: Status 404 returned error can't find the container with id 3f1ab072bd30102535f455e12d6405168020311fa6c064207e2dc7cb398de0d4
Sep 10 04:27:13.575684 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:13.575638    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6fvh" event={"ID":"68819b9e-ee1e-47c2-b8a5-ce1857439665","Type":"ContainerStarted","Data":"74687e25c57cb0527833f0bc655f96ef7eb0cf77522ad07f94056ab097cdc9d7"}
Sep 10 04:27:13.577431 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:13.577396    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9cd9j" event={"ID":"f3935ba8-636e-474c-b7cc-22854fed158a","Type":"ContainerStarted","Data":"3f1ab072bd30102535f455e12d6405168020311fa6c064207e2dc7cb398de0d4"}
Sep 10 04:27:18.596467 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:18.596425    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x6fvh" event={"ID":"68819b9e-ee1e-47c2-b8a5-ce1857439665","Type":"ContainerStarted","Data":"ba4afcc394ff6fb0218c9817e83b06e9e64be56782361f64978de8e239c9f010"}
Sep 10 04:27:18.598041 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:18.598009    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9cd9j" event={"ID":"f3935ba8-636e-474c-b7cc-22854fed158a","Type":"ContainerStarted","Data":"578eb16f1d84e63d8bb30c8fb207657f4b943042f5b7352ebe76fa4e6412d4cf"}
Sep 10 04:27:18.598173 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:18.598144    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:27:18.612136 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:18.612092    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x6fvh" podStartSLOduration=67.180314298 podStartE2EDuration="1m12.612077625s" totalImagesPullingTime="5.431763327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:18.610963697 +0000 UTC m=+72.828990350" watchObservedRunningTime="2026-09-10 04:27:18.612077625 +0000 UTC m=+72.830104274"
Sep 10 04:27:18.625397 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:18.625353    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9cd9j" podStartSLOduration=67.207930566 podStartE2EDuration="1m12.625341663s" totalImagesPullingTime="5.417411097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:18.624075666 +0000 UTC m=+72.842102317" watchObservedRunningTime="2026-09-10 04:27:18.625341663 +0000 UTC m=+72.843368330"
Sep 10 04:27:30.282446 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.282324    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h7z28"]
Sep 10 04:27:30.285564 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.285544    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.287614 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.287591    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 04:27:30.287916 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.287898    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 04:27:30.288448 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.288429    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 04:27:30.288522 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.288448    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d2589\""
Sep 10 04:27:30.288577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.288451    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 04:27:30.295624 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.295605    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7z28"]
Sep 10 04:27:30.364220 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.364183    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b935618-42c1-4e86-ad7a-433e5f671bf6-crio-socket\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.364220 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.364219    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b935618-42c1-4e86-ad7a-433e5f671bf6-data-volume\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.364423 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.364248    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.364423 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.364264    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjrg\" (UniqueName: \"kubernetes.io/projected/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-api-access-cbjrg\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.364423 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.364355    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464653    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b935618-42c1-4e86-ad7a-433e5f671bf6-crio-socket\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464685    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b935618-42c1-4e86-ad7a-433e5f671bf6-data-volume\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464884 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464712    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464884 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.464770    2526 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:27:30.464884 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464781    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4b935618-42c1-4e86-ad7a-433e5f671bf6-crio-socket\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464884 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464825    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjrg\" (UniqueName: \"kubernetes.io/projected/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-api-access-cbjrg\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.464884 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.464834    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.964818158 +0000 UTC m=+85.182844785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : configmap "kube-rbac-proxy" not found
Sep 10 04:27:30.465106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464906    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.465106 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.464995    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b935618-42c1-4e86-ad7a-433e5f671bf6-data-volume\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.465106 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.465038    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:30.465106 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.465085    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:30.965072879 +0000 UTC m=+85.183099510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:30.476225 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.476198    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjrg\" (UniqueName: \"kubernetes.io/projected/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-api-access-cbjrg\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.967378 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.967334    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.967552 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:30.967397    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:30.967552 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.967457    2526 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:27:30.967552 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.967535    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.967520444 +0000 UTC m=+86.185547071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : configmap "kube-rbac-proxy" not found
Sep 10 04:27:30.967662 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.967568    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:30.967662 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:30.967633    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:31.967618912 +0000 UTC m=+86.185645550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:31.975838 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:31.975799    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:31.976258 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:31.975861    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:31.976258 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:31.975954    2526 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:27:31.976258 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:31.976017    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:31.976258 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:31.976031    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.976011526 +0000 UTC m=+88.194038174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : configmap "kube-rbac-proxy" not found
Sep 10 04:27:31.976258 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:31.976057    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:33.976045162 +0000 UTC m=+88.194071802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:33.055304 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:33.055276    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pf2s7_9a52f818-b30f-44fb-982c-6a206dbb8dd7/dns-node-resolver/0.log"
Sep 10 04:27:33.854909 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:33.854885    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nj585_6fef90e3-41fe-47ea-be33-937fa28a2427/node-ca/0.log"
Sep 10 04:27:33.990609 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:33.990563    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:33.990772 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:33.990686    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:33.990772 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:33.990732    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:33.990772 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:33.990764    2526 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:27:33.990872 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:33.990802    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.990783576 +0000 UTC m=+92.208810227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:33.990872 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:33.990819    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:37.990811802 +0000 UTC m=+92.208838433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : configmap "kube-rbac-proxy" not found
Sep 10 04:27:35.055832 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:35.055804    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xr4vn_d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2/serve-healthcheck-canary/0.log"
Sep 10 04:27:38.022920 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:38.022881    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:38.023444 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:38.022965    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:38.023444 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:38.022998    2526 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 04:27:38.023444 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:38.023074    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:46.023058499 +0000 UTC m=+100.241085131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : configmap "kube-rbac-proxy" not found
Sep 10 04:27:38.023444 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:38.023099    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:38.023444 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:38.023169    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:27:46.023153053 +0000 UTC m=+100.241179683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:42.557520 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.557483    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:42.557520 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.557536    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:27:42.559887 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.559855    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9d98d7d6-96a4-4237-b749-a89bd1adfa88-metrics-tls\") pod \"dns-default-74ctt\" (UID: \"9d98d7d6-96a4-4237-b749-a89bd1adfa88\") " pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:42.560021 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.559972    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"image-registry-5fcb6fb458-5xrtw\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") " pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:27:42.844716 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.844627    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bgv6k\""
Sep 10 04:27:42.850317 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.850297    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w9vrw\""
Sep 10 04:27:42.852987 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.852973    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:27:42.858901 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:42.858879    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:43.129199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.129125    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:27:43.132462 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:27:43.132434    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884277b3_7f47_4165_adb0_b6d6da2ba3a6.slice/crio-8a4b979bf7bede45c3b63a555826c4a3535fc25451a07611d084e892badbcaeb WatchSource:0}: Error finding container 8a4b979bf7bede45c3b63a555826c4a3535fc25451a07611d084e892badbcaeb: Status 404 returned error can't find the container with id 8a4b979bf7bede45c3b63a555826c4a3535fc25451a07611d084e892badbcaeb
Sep 10 04:27:43.135384 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.135363    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74ctt"]
Sep 10 04:27:43.138311 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:27:43.138291    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d98d7d6_96a4_4237_b749_a89bd1adfa88.slice/crio-7cf81af5c5a643eeeed742db698f732291cd91e6d93ee4d026b8624d7965fa5e WatchSource:0}: Error finding container 7cf81af5c5a643eeeed742db698f732291cd91e6d93ee4d026b8624d7965fa5e: Status 404 returned error can't find the container with id 7cf81af5c5a643eeeed742db698f732291cd91e6d93ee4d026b8624d7965fa5e
Sep 10 04:27:43.681281 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.681244    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74ctt" event={"ID":"9d98d7d6-96a4-4237-b749-a89bd1adfa88","Type":"ContainerStarted","Data":"7cf81af5c5a643eeeed742db698f732291cd91e6d93ee4d026b8624d7965fa5e"}
Sep 10 04:27:43.682813 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.682785    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" event={"ID":"884277b3-7f47-4165-adb0-b6d6da2ba3a6","Type":"ContainerStarted","Data":"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"}
Sep 10 04:27:43.682951 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.682827    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" event={"ID":"884277b3-7f47-4165-adb0-b6d6da2ba3a6","Type":"ContainerStarted","Data":"8a4b979bf7bede45c3b63a555826c4a3535fc25451a07611d084e892badbcaeb"}
Sep 10 04:27:43.682951 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.682910    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:27:43.700321 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:43.700274    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" podStartSLOduration=97.700260112 podStartE2EDuration="1m37.700260112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:43.699637857 +0000 UTC m=+97.917664508" watchObservedRunningTime="2026-09-10 04:27:43.700260112 +0000 UTC m=+97.918286762"
Sep 10 04:27:45.691204 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:45.691171    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74ctt" event={"ID":"9d98d7d6-96a4-4237-b749-a89bd1adfa88","Type":"ContainerStarted","Data":"dfe43ca4e6193cb77ef6a4120a002cfc3ed0db9289c1b35c86682babb4ef7424"}
Sep 10 04:27:45.691672 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:45.691228    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74ctt" event={"ID":"9d98d7d6-96a4-4237-b749-a89bd1adfa88","Type":"ContainerStarted","Data":"9a8b58d1d88bc7c8995d4ed168f85da68cfd32bd4bb3feb7d604928c60e438c9"}
Sep 10 04:27:45.691672 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:45.691300    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:45.708865 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:45.708789    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-74ctt" podStartSLOduration=65.712261183 podStartE2EDuration="1m7.708767974s" totalImagesPullingTime="1.996506791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:27:45.707295664 +0000 UTC m=+99.925322313" watchObservedRunningTime="2026-09-10 04:27:45.708767974 +0000 UTC m=+99.926794624"
Sep 10 04:27:46.085018 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:46.084983    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:46.085191 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:46.085026    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:46.085191 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:46.085138    2526 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:46.085191 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:27:46.085189    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls podName:4b935618-42c1-4e86-ad7a-433e5f671bf6 nodeName:}" failed. No retries permitted until 2026-09-10 04:28:02.085176135 +0000 UTC m=+116.303202762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h7z28" (UID: "4b935618-42c1-4e86-ad7a-433e5f671bf6") : secret "insights-runtime-extractor-tls" not found
Sep 10 04:27:46.085531 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:46.085508    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4b935618-42c1-4e86-ad7a-433e5f671bf6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:27:49.603755 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:49.603719    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9cd9j"
Sep 10 04:27:55.696718 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:55.696687    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-74ctt"
Sep 10 04:27:58.913756 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:27:58.913695    2526 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" podUID="a0ee1535-780c-4acc-bf45-99c65481c462" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 04:28:02.098356 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.098299    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:28:02.100609 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.100585    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4b935618-42c1-4e86-ad7a-433e5f671bf6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7z28\" (UID: \"4b935618-42c1-4e86-ad7a-433e5f671bf6\") " pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:28:02.394804 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.394722    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7z28"
Sep 10 04:28:02.664135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.664060    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7z28"]
Sep 10 04:28:02.666796 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:28:02.666764    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b935618_42c1_4e86_ad7a_433e5f671bf6.slice/crio-b16ffdcc58edaed9f096f66c07196135cf081ce1e79fc8fbf63ee1a4377d5a36 WatchSource:0}: Error finding container b16ffdcc58edaed9f096f66c07196135cf081ce1e79fc8fbf63ee1a4377d5a36: Status 404 returned error can't find the container with id b16ffdcc58edaed9f096f66c07196135cf081ce1e79fc8fbf63ee1a4377d5a36
Sep 10 04:28:02.747850 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.747810    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7z28" event={"ID":"4b935618-42c1-4e86-ad7a-433e5f671bf6","Type":"ContainerStarted","Data":"e163ede1b401639b1f0d40d6791c6b0cfbdbd7af888293d80d8920e6b2c436d6"}
Sep 10 04:28:02.748002 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.747879    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7z28" event={"ID":"4b935618-42c1-4e86-ad7a-433e5f671bf6","Type":"ContainerStarted","Data":"b16ffdcc58edaed9f096f66c07196135cf081ce1e79fc8fbf63ee1a4377d5a36"}
Sep 10 04:28:02.857791 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.857756    2526 patch_prober.go:28] interesting pod/image-registry-5fcb6fb458-5xrtw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 10 04:28:02.857982 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:02.857808    2526 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 04:28:03.752066 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:03.751979    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7z28" event={"ID":"4b935618-42c1-4e86-ad7a-433e5f671bf6","Type":"ContainerStarted","Data":"203d6b5dd855e9e5a94bc94db083342098fb591c7c2ab0e49ff2c355e43f8bd4"}
Sep 10 04:28:04.690620 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:04.690593    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:28:06.763417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:06.763377    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7z28" event={"ID":"4b935618-42c1-4e86-ad7a-433e5f671bf6","Type":"ContainerStarted","Data":"9ad4c5aa03b99ac2f9c536c07d8fabec37a292cc9d33a95176d4635d06d04226"}
Sep 10 04:28:06.780089 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:06.780027    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h7z28" podStartSLOduration=33.796809904 podStartE2EDuration="36.780011192s" totalImagesPullingTime="2.983201288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:27:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:06.778687829 +0000 UTC m=+120.996714471" watchObservedRunningTime="2026-09-10 04:28:06.780011192 +0000 UTC m=+120.998037842"
Sep 10 04:28:08.652505 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.652464    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kklzs"]
Sep 10 04:28:08.656507 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.656487    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.658726 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.658707    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sltvl\""
Sep 10 04:28:08.658830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.658706    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 04:28:08.658830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.658744    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 04:28:08.658830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.658703    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 04:28:08.659425 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.659407    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 04:28:08.659572 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.659545    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 04:28:08.659708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.659693    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 04:28:08.742882 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.742848    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-root\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.742882 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.742883    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-metrics-client-ca\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.742910    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr56\" (UniqueName: \"kubernetes.io/projected/bdbd284e-f246-4637-9b5a-89b20b19c17a-kube-api-access-thr56\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.742987    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-wtmp\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.743004    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.743070    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-sys\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.743124    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743354 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.743171    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-textfile\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.743354 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.743216    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.843892 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.843851    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-textfile\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.843892 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.843894    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844015    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-root\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844057    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-metrics-client-ca\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844096    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thr56\" (UniqueName: \"kubernetes.io/projected/bdbd284e-f246-4637-9b5a-89b20b19c17a-kube-api-access-thr56\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844110    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-root\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844132    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-wtmp\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844158    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844185    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-sys\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844216    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844255    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-sys\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844312    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-textfile\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844319    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-wtmp\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:28:08.844351    2526 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 04:28:08.844426 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:28:08.844427    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls podName:bdbd284e-f246-4637-9b5a-89b20b19c17a nodeName:}" failed. No retries permitted until 2026-09-10 04:28:09.344407487 +0000 UTC m=+123.562434131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls") pod "node-exporter-kklzs" (UID: "bdbd284e-f246-4637-9b5a-89b20b19c17a") : secret "node-exporter-tls" not found
Sep 10 04:28:08.844727 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844709    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-accelerators-collector-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.844769 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.844713    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbd284e-f246-4637-9b5a-89b20b19c17a-metrics-client-ca\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.846447 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.846423    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.852828 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.852802    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr56\" (UniqueName: \"kubernetes.io/projected/bdbd284e-f246-4637-9b5a-89b20b19c17a-kube-api-access-thr56\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:08.913666 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:08.913588    2526 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" podUID="a0ee1535-780c-4acc-bf45-99c65481c462" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 04:28:09.347103 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:09.347067    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:09.347317 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:28:09.347259    2526 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 10 04:28:09.347385 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:28:09.347351    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls podName:bdbd284e-f246-4637-9b5a-89b20b19c17a nodeName:}" failed. No retries permitted until 2026-09-10 04:28:10.347329231 +0000 UTC m=+124.565355878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls") pod "node-exporter-kklzs" (UID: "bdbd284e-f246-4637-9b5a-89b20b19c17a") : secret "node-exporter-tls" not found
Sep 10 04:28:10.354156 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:10.354118    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:10.356347 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:10.356329    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdbd284e-f246-4637-9b5a-89b20b19c17a-node-exporter-tls\") pod \"node-exporter-kklzs\" (UID: \"bdbd284e-f246-4637-9b5a-89b20b19c17a\") " pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:10.464747 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:10.464713    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kklzs"
Sep 10 04:28:10.475872 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:28:10.475844    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbd284e_f246_4637_9b5a_89b20b19c17a.slice/crio-434e06d63e967cf90c2254884050ede80a3db73ba18ab9f469de389682dd897d WatchSource:0}: Error finding container 434e06d63e967cf90c2254884050ede80a3db73ba18ab9f469de389682dd897d: Status 404 returned error can't find the container with id 434e06d63e967cf90c2254884050ede80a3db73ba18ab9f469de389682dd897d
Sep 10 04:28:10.777527 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:10.777436    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kklzs" event={"ID":"bdbd284e-f246-4637-9b5a-89b20b19c17a","Type":"ContainerStarted","Data":"434e06d63e967cf90c2254884050ede80a3db73ba18ab9f469de389682dd897d"}
Sep 10 04:28:11.782895 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:11.782859    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kklzs" event={"ID":"bdbd284e-f246-4637-9b5a-89b20b19c17a","Type":"ContainerStarted","Data":"4fe8adabd5848d27e466fc77f902605b4eb32c25f3a2152134c19e21d31c8de7"}
Sep 10 04:28:12.787538 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:12.787505    2526 generic.go:356] "Generic (PLEG): container finished" podID="bdbd284e-f246-4637-9b5a-89b20b19c17a" containerID="4fe8adabd5848d27e466fc77f902605b4eb32c25f3a2152134c19e21d31c8de7" exitCode=0
Sep 10 04:28:12.787970 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:12.787597    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kklzs" event={"ID":"bdbd284e-f246-4637-9b5a-89b20b19c17a","Type":"ContainerDied","Data":"4fe8adabd5848d27e466fc77f902605b4eb32c25f3a2152134c19e21d31c8de7"}
Sep 10 04:28:13.793704 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:13.793664    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kklzs" event={"ID":"bdbd284e-f246-4637-9b5a-89b20b19c17a","Type":"ContainerStarted","Data":"8a3db70a8cd17ec2919485643d9af96fe6b113689a746b35303df1c09ba4e58e"}
Sep 10 04:28:13.794121 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:13.793741    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kklzs" event={"ID":"bdbd284e-f246-4637-9b5a-89b20b19c17a","Type":"ContainerStarted","Data":"3c1390b69b8a4cda5067cac9fe55515141b55fbbc0e5cf1c3faec6eebf3c57f2"}
Sep 10 04:28:13.813285 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:13.813239    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kklzs" podStartSLOduration=4.586957131 podStartE2EDuration="5.813226097s" totalImagesPullingTime="1.165081096s" totalInitContainerRuntime="61.18787ms" isStatefulPod=true podCreationTimestamp="2026-09-10 04:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:13.812396759 +0000 UTC m=+128.030423409" watchObservedRunningTime="2026-09-10 04:28:13.813226097 +0000 UTC m=+128.031252757"
Sep 10 04:28:16.097170 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.097134    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:28:16.099435 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.099408    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49799fb0-faa9-433b-8f94-a9873983ffda-metrics-certs\") pod \"network-metrics-daemon-84mxk\" (UID: \"49799fb0-faa9-433b-8f94-a9873983ffda\") " pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:28:16.342475 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.342446    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lmcvv\""
Sep 10 04:28:16.351075 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.351022    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84mxk"
Sep 10 04:28:16.621024 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.620952    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84mxk"]
Sep 10 04:28:16.623939 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:28:16.623896    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49799fb0_faa9_433b_8f94_a9873983ffda.slice/crio-ea1fa67b9e3fe8832f4ec13db72ee6c760fb5e8a91147e2c19667c799e889af5 WatchSource:0}: Error finding container ea1fa67b9e3fe8832f4ec13db72ee6c760fb5e8a91147e2c19667c799e889af5: Status 404 returned error can't find the container with id ea1fa67b9e3fe8832f4ec13db72ee6c760fb5e8a91147e2c19667c799e889af5
Sep 10 04:28:16.805241 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:16.805207    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84mxk" event={"ID":"49799fb0-faa9-433b-8f94-a9873983ffda","Type":"ContainerStarted","Data":"ea1fa67b9e3fe8832f4ec13db72ee6c760fb5e8a91147e2c19667c799e889af5"}
Sep 10 04:28:17.812322 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:17.812292    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84mxk" event={"ID":"49799fb0-faa9-433b-8f94-a9873983ffda","Type":"ContainerStarted","Data":"da28d4c1902e2379c7ad3718bfe91423246b0d82260174394db19495097bc1fc"}
Sep 10 04:28:18.094477 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.094437    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:28:18.817133 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.817093    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84mxk" event={"ID":"49799fb0-faa9-433b-8f94-a9873983ffda","Type":"ContainerStarted","Data":"372eb312a65340579e540769e1d3c5f4324fdf0c28c63b7399e8b869b4f1c0b2"}
Sep 10 04:28:18.833517 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.833468    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-84mxk" podStartSLOduration=131.786194013 podStartE2EDuration="2m12.833450863s" totalImagesPullingTime="1.04725685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:28:18.83314249 +0000 UTC m=+133.051169141" watchObservedRunningTime="2026-09-10 04:28:18.833450863 +0000 UTC m=+133.051477522"
Sep 10 04:28:18.914028 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.913975    2526 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" podUID="a0ee1535-780c-4acc-bf45-99c65481c462" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 10 04:28:18.914150 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.914057    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g"
Sep 10 04:28:18.914504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.914475    2526 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5f311ab2e0dce1d7d4566dfcc644c7ff4f1854c76427ef2cbc1aa8e5e4d7b516"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 10 04:28:18.914537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:18.914523    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" podUID="a0ee1535-780c-4acc-bf45-99c65481c462" containerName="service-proxy" containerID="cri-o://5f311ab2e0dce1d7d4566dfcc644c7ff4f1854c76427ef2cbc1aa8e5e4d7b516" gracePeriod=30
Sep 10 04:28:19.823620 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:19.823586    2526 generic.go:356] "Generic (PLEG): container finished" podID="a0ee1535-780c-4acc-bf45-99c65481c462" containerID="5f311ab2e0dce1d7d4566dfcc644c7ff4f1854c76427ef2cbc1aa8e5e4d7b516" exitCode=2
Sep 10 04:28:19.824012 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:19.823668    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerDied","Data":"5f311ab2e0dce1d7d4566dfcc644c7ff4f1854c76427ef2cbc1aa8e5e4d7b516"}
Sep 10 04:28:19.824012 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:19.823726    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fbddb66b8-tzc5g" event={"ID":"a0ee1535-780c-4acc-bf45-99c65481c462","Type":"ContainerStarted","Data":"48936252103dbe25e5dd815f00567821d029fa1eebefe89b83abe9e351080304"}
Sep 10 04:28:43.113805 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.113744    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerName="registry" containerID="cri-o://36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd" gracePeriod=30
Sep 10 04:28:43.361376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.361349    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:28:43.480503 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480409    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480503 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480455    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480503 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480483    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480522    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480547    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480577    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480608    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.480774 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480638    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72v7p\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p\") pod \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\" (UID: \"884277b3-7f47-4165-adb0-b6d6da2ba3a6\") "
Sep 10 04:28:43.481070 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.480958    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:28:43.481070 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.481019    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:28:43.483164 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.483133    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:28:43.483321 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.483275    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:28:43.483438 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.483362    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:28:43.483498 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.483443    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p" (OuterVolumeSpecName: "kube-api-access-72v7p") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "kube-api-access-72v7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:28:43.483498 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.483466    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:28:43.488753 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.488731    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "884277b3-7f47-4165-adb0-b6d6da2ba3a6" (UID: "884277b3-7f47-4165-adb0-b6d6da2ba3a6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:28:43.581919 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581886    2526 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-image-registry-private-configuration\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.581919 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581912    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72v7p\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-kube-api-access-72v7p\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.581919 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581922    2526 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/884277b3-7f47-4165-adb0-b6d6da2ba3a6-ca-trust-extracted\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.582222 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581952    2526 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-certificates\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.582222 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581972    2526 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/884277b3-7f47-4165-adb0-b6d6da2ba3a6-trusted-ca\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.582222 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581980    2526 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-registry-tls\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.582222 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.581987    2526 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/884277b3-7f47-4165-adb0-b6d6da2ba3a6-bound-sa-token\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.582222 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.582013    2526 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/884277b3-7f47-4165-adb0-b6d6da2ba3a6-installation-pull-secrets\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:28:43.904781 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.904749    2526 generic.go:356] "Generic (PLEG): container finished" podID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerID="36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd" exitCode=0
Sep 10 04:28:43.904961 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.904794    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw"
Sep 10 04:28:43.904961 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.904833    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" event={"ID":"884277b3-7f47-4165-adb0-b6d6da2ba3a6","Type":"ContainerDied","Data":"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"}
Sep 10 04:28:43.904961 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.904885    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fcb6fb458-5xrtw" event={"ID":"884277b3-7f47-4165-adb0-b6d6da2ba3a6","Type":"ContainerDied","Data":"8a4b979bf7bede45c3b63a555826c4a3535fc25451a07611d084e892badbcaeb"}
Sep 10 04:28:43.904961 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.904906    2526 scope.go:117] "RemoveContainer" containerID="36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"
Sep 10 04:28:43.913070 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.913050    2526 scope.go:117] "RemoveContainer" containerID="36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"
Sep 10 04:28:43.913336 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:28:43.913316    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd\": container with ID starting with 36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd not found: ID does not exist" containerID="36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"
Sep 10 04:28:43.913386 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.913344    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd"} err="failed to get container status \"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd\": rpc error: code = NotFound desc = could not find container \"36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd\": container with ID starting with 36fbfc8bdd6e8a2b6385d593cbb679acba9472108b0c772646f10368b80507bd not found: ID does not exist"
Sep 10 04:28:43.926143 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.926117    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:28:43.930597 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:43.930576    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fcb6fb458-5xrtw"]
Sep 10 04:28:44.302654 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:28:44.302623    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" path="/var/lib/kubelet/pods/884277b3-7f47-4165-adb0-b6d6da2ba3a6/volumes"
Sep 10 04:31:06.211772 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:31:06.211744    2526 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 04:32:37.780126 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.780091    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"]
Sep 10 04:32:37.780607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.780328    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerName="registry"
Sep 10 04:32:37.780607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.780338    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerName="registry"
Sep 10 04:32:37.780607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.780380    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="884277b3-7f47-4165-adb0-b6d6da2ba3a6" containerName="registry"
Sep 10 04:32:37.782964 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.782949    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.785132 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.785110    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 04:32:37.785956 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.785920    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hvpj6\""
Sep 10 04:32:37.786056 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.785953    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 04:32:37.789385 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.789361    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"]
Sep 10 04:32:37.852125 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.852078    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxljd\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-kube-api-access-wxljd\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.852125 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.852128    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.953233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.953195    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxljd\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-kube-api-access-wxljd\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.953233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.953234    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.960496 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.960464    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:37.960649 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:37.960610    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxljd\" (UniqueName: \"kubernetes.io/projected/e9b0d005-0ddd-4ef5-9882-6a40c0b80303-kube-api-access-wxljd\") pod \"cert-manager-cainjector-559cdd8c87-qcghb\" (UID: \"e9b0d005-0ddd-4ef5-9882-6a40c0b80303\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:38.093381 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:38.093344    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"
Sep 10 04:32:38.362380 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:38.362298    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qcghb"]
Sep 10 04:32:38.365997 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:32:38.365961    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9b0d005_0ddd_4ef5_9882_6a40c0b80303.slice/crio-43f9130fbd4305be6797606f750a70293d2da3f94bf9e2ded80f4fb9db61f77e WatchSource:0}: Error finding container 43f9130fbd4305be6797606f750a70293d2da3f94bf9e2ded80f4fb9db61f77e: Status 404 returned error can't find the container with id 43f9130fbd4305be6797606f750a70293d2da3f94bf9e2ded80f4fb9db61f77e
Sep 10 04:32:38.368020 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:38.368003    2526 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:32:38.677768 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:38.677687    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb" event={"ID":"e9b0d005-0ddd-4ef5-9882-6a40c0b80303","Type":"ContainerStarted","Data":"43f9130fbd4305be6797606f750a70293d2da3f94bf9e2ded80f4fb9db61f77e"}
Sep 10 04:32:41.691061 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:41.691016    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb" event={"ID":"e9b0d005-0ddd-4ef5-9882-6a40c0b80303","Type":"ContainerStarted","Data":"d81d71da0006bbf1546bca3146799390cd9b0ed5112d13649c241aeeb9732232"}
Sep 10 04:32:41.705746 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:32:41.705697    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qcghb" podStartSLOduration=1.920956761 podStartE2EDuration="4.705682436s" totalImagesPullingTime="2.784725675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:32:41.70466289 +0000 UTC m=+395.922689539" watchObservedRunningTime="2026-09-10 04:32:41.705682436 +0000 UTC m=+395.923709084"
Sep 10 04:33:22.805344 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.805308    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"]
Sep 10 04:33:22.810505 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.810482    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.813291 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.813268    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 04:33:22.813474 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.813455    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 04:33:22.813529 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.813517    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pr9xr\""
Sep 10 04:33:22.813575 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.813529    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 04:33:22.813575 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.813550    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 04:33:22.823325 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.823299    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"]
Sep 10 04:33:22.871563 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.871524    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-splrm\" (UniqueName: \"kubernetes.io/projected/b2750d83-8243-4524-817f-0b6b9696ebf6-kube-api-access-splrm\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.871563 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.871564    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.871777 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.871588    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.871777 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.871603    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.871777 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.871644    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.972590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.972549    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-splrm\" (UniqueName: \"kubernetes.io/projected/b2750d83-8243-4524-817f-0b6b9696ebf6-kube-api-access-splrm\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.972590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.972591    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.972793 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.972613    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.972793 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.972637    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.972793 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.972680    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.973064 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.973043    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-manifests\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.975334 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.975308    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.975543 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.975521    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2750d83-8243-4524-817f-0b6b9696ebf6-tmp\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.975720 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.975689    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2750d83-8243-4524-817f-0b6b9696ebf6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:22.980741 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:22.980715    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-splrm\" (UniqueName: \"kubernetes.io/projected/b2750d83-8243-4524-817f-0b6b9696ebf6-kube-api-access-splrm\") pod \"opendatahub-operator-controller-manager-7c4448dfb9-z9q8j\" (UID: \"b2750d83-8243-4524-817f-0b6b9696ebf6\") " pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:23.119955 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:23.119867    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:23.419713 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:23.419613    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"]
Sep 10 04:33:23.423696 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:33:23.423671    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2750d83_8243_4524_817f_0b6b9696ebf6.slice/crio-c04cf7b376120333eeb3e97ed5138219ce8567da5d854f1a47d1c69f42f1d8bd WatchSource:0}: Error finding container c04cf7b376120333eeb3e97ed5138219ce8567da5d854f1a47d1c69f42f1d8bd: Status 404 returned error can't find the container with id c04cf7b376120333eeb3e97ed5138219ce8567da5d854f1a47d1c69f42f1d8bd
Sep 10 04:33:23.827843 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:23.827811    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j" event={"ID":"b2750d83-8243-4524-817f-0b6b9696ebf6","Type":"ContainerStarted","Data":"c04cf7b376120333eeb3e97ed5138219ce8567da5d854f1a47d1c69f42f1d8bd"}
Sep 10 04:33:26.840369 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:26.840328    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j" event={"ID":"b2750d83-8243-4524-817f-0b6b9696ebf6","Type":"ContainerStarted","Data":"b65774ef7a851306469a58f3d515eb332fdb80593597ed509f0ad67cc97f969e"}
Sep 10 04:33:27.845602 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:27.845567    2526 generic.go:356] "Generic (PLEG): container finished" podID="b2750d83-8243-4524-817f-0b6b9696ebf6" containerID="b65774ef7a851306469a58f3d515eb332fdb80593597ed509f0ad67cc97f969e" exitCode=0
Sep 10 04:33:27.846143 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:27.845615    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j" event={"ID":"b2750d83-8243-4524-817f-0b6b9696ebf6","Type":"ContainerDied","Data":"b65774ef7a851306469a58f3d515eb332fdb80593597ed509f0ad67cc97f969e"}
Sep 10 04:33:28.851043 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:28.850986    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j" event={"ID":"b2750d83-8243-4524-817f-0b6b9696ebf6","Type":"ContainerStarted","Data":"7f058e75199a285b0b27033fb7dbb952e30b672697ad95263d07b9fa14da0e04"}
Sep 10 04:33:28.851418 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:28.851243    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:28.871048 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:28.870995    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j" podStartSLOduration=2.270560373 podStartE2EDuration="6.870980044s" totalImagesPullingTime="3.579136049s" totalInitContainerRuntime="1.021283622s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:33:28.870677237 +0000 UTC m=+443.088703891" watchObservedRunningTime="2026-09-10 04:33:28.870980044 +0000 UTC m=+443.089006705"
Sep 10 04:33:39.857158 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:39.857121    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c4448dfb9-z9q8j"
Sep 10 04:33:52.974662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.974626    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"]
Sep 10 04:33:52.982978 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.982951    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:52.985607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.985580    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 04:33:52.986332 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.986309    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 04:33:52.986418 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.986349    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 10 04:33:52.986418 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.986371    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vswlw\""
Sep 10 04:33:52.986418 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.986386    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 10 04:33:52.989199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:52.989177    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"]
Sep 10 04:33:53.090994 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.090949    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.091149 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.091007    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245fec92-534d-47e1-9098-521cc3b7bca1-tmp\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.091149 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.091034    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jbr\" (UniqueName: \"kubernetes.io/projected/245fec92-534d-47e1-9098-521cc3b7bca1-kube-api-access-h4jbr\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.096524 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.096497    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9h5x"]
Sep 10 04:33:53.099709 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.099690    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.101844 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.101823    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cpj2t\""
Sep 10 04:33:53.102122 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.102106    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 04:33:53.111603 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.111580    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9h5x"]
Sep 10 04:33:53.191479 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.191451    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245fec92-534d-47e1-9098-521cc3b7bca1-tmp\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.191656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.191491    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dp75\" (UniqueName: \"kubernetes.io/projected/31889ee2-17ab-4050-b0ac-8c14566e0dd6-kube-api-access-7dp75\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.191656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.191515    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jbr\" (UniqueName: \"kubernetes.io/projected/245fec92-534d-47e1-9098-521cc3b7bca1-kube-api-access-h4jbr\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.191656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.191583    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.191656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.191649    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.191807 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:33:53.191757    2526 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 10 04:33:53.191845 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:33:53.191826    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs podName:245fec92-534d-47e1-9098-521cc3b7bca1 nodeName:}" failed. No retries permitted until 2026-09-10 04:33:53.691807522 +0000 UTC m=+467.909834157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs") pod "kube-auth-proxy-dbb8dffb6-dfqx6" (UID: "245fec92-534d-47e1-9098-521cc3b7bca1") : secret "kube-auth-proxy-tls" not found
Sep 10 04:33:53.193718 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.193693    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/245fec92-534d-47e1-9098-521cc3b7bca1-tmp\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.203472 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.203448    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jbr\" (UniqueName: \"kubernetes.io/projected/245fec92-534d-47e1-9098-521cc3b7bca1-kube-api-access-h4jbr\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.292438 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.292404    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.292589 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.292504    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dp75\" (UniqueName: \"kubernetes.io/projected/31889ee2-17ab-4050-b0ac-8c14566e0dd6-kube-api-access-7dp75\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.292589 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:33:53.292556    2526 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 04:33:53.292663 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:33:53.292638    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert podName:31889ee2-17ab-4050-b0ac-8c14566e0dd6 nodeName:}" failed. No retries permitted until 2026-09-10 04:33:53.792620392 +0000 UTC m=+468.010647025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert") pod "odh-model-controller-7998c67dc4-l9h5x" (UID: "31889ee2-17ab-4050-b0ac-8c14566e0dd6") : secret "odh-model-controller-webhook-cert" not found
Sep 10 04:33:53.304385 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.304357    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dp75\" (UniqueName: \"kubernetes.io/projected/31889ee2-17ab-4050-b0ac-8c14566e0dd6-kube-api-access-7dp75\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.560065 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.559980    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d6qc"]
Sep 10 04:33:53.563941 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.563902    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.566715 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.566694    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5699d\""
Sep 10 04:33:53.566859 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.566840    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 04:33:53.580325 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.580292    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d6qc"]
Sep 10 04:33:53.696940 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.696886    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b84c280-d9ef-4d15-9185-7bd50418b278-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.697119 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.696994    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm76x\" (UniqueName: \"kubernetes.io/projected/9b84c280-d9ef-4d15-9185-7bd50418b278-kube-api-access-sm76x\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.697171 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.697120    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.699574 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.699544    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/245fec92-534d-47e1-9098-521cc3b7bca1-tls-certs\") pod \"kube-auth-proxy-dbb8dffb6-dfqx6\" (UID: \"245fec92-534d-47e1-9098-521cc3b7bca1\") " pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.797981 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.797944    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.798167 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.798001    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b84c280-d9ef-4d15-9185-7bd50418b278-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.798167 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.798021    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm76x\" (UniqueName: \"kubernetes.io/projected/9b84c280-d9ef-4d15-9185-7bd50418b278-kube-api-access-sm76x\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.800746 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.800711    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b84c280-d9ef-4d15-9185-7bd50418b278-tls-certs\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.800865 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.800778    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31889ee2-17ab-4050-b0ac-8c14566e0dd6-cert\") pod \"odh-model-controller-7998c67dc4-l9h5x\" (UID: \"31889ee2-17ab-4050-b0ac-8c14566e0dd6\") " pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:53.808585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.808558    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm76x\" (UniqueName: \"kubernetes.io/projected/9b84c280-d9ef-4d15-9185-7bd50418b278-kube-api-access-sm76x\") pod \"model-serving-api-54d89bd5fc-6d6qc\" (UID: \"9b84c280-d9ef-4d15-9185-7bd50418b278\") " pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.875688 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.875586    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:33:53.893941 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.893884    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"
Sep 10 04:33:53.998270 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:53.998234    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:33:54.001956 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.001914    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.005363 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.005341    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 04:33:54.005496 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.005366    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 04:33:54.005630 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.005613    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 04:33:54.005816 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.005792    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 04:33:54.006098 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.006083    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bh2dg\""
Sep 10 04:33:54.009782 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.009763    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:33:54.019039 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.015583    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:33:54.100630 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100592    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.100630 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100632    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.100830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100656    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.100830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100722    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.100830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100770    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns29m\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.100830 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100817    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.101012 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.100837    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.150218 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.150140    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6d6qc"]
Sep 10 04:33:54.153259 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:33:54.153230    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b84c280_d9ef_4d15_9185_7bd50418b278.slice/crio-3b6aa1183e0fa90909952708b5bb39d02925105f9595075e913edcfffa8ff8c3 WatchSource:0}: Error finding container 3b6aa1183e0fa90909952708b5bb39d02925105f9595075e913edcfffa8ff8c3: Status 404 returned error can't find the container with id 3b6aa1183e0fa90909952708b5bb39d02925105f9595075e913edcfffa8ff8c3
Sep 10 04:33:54.176036 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.176011    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6"]
Sep 10 04:33:54.178462 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:33:54.178431    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245fec92_534d_47e1_9098_521cc3b7bca1.slice/crio-569fa4c2bd9c195f9541550cea1afac1d2fb11bb53877e12dc0e83812b97d83a WatchSource:0}: Error finding container 569fa4c2bd9c195f9541550cea1afac1d2fb11bb53877e12dc0e83812b97d83a: Status 404 returned error can't find the container with id 569fa4c2bd9c195f9541550cea1afac1d2fb11bb53877e12dc0e83812b97d83a
Sep 10 04:33:54.202220 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202188    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202350 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202223    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202407 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202362    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202467 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202409    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202467 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202447    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202560 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202486    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.202560 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.202541    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns29m\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.203535 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.203460    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.205157 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.205135    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.205486 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.205463    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.205581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.205502    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.205581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.205562    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.209798 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.209774    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.210116 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.210098    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns29m\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m\") pod \"istiod-openshift-gateway-7b7995d5cd-cfkvx\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.279545 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.279511    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l9h5x"]
Sep 10 04:33:54.283051 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:33:54.283016    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31889ee2_17ab_4050_b0ac_8c14566e0dd6.slice/crio-bd720ea0b2305ac182f97e35b1f9b6ab1fc4b09f92571aa87540f0062d7fb2ad WatchSource:0}: Error finding container bd720ea0b2305ac182f97e35b1f9b6ab1fc4b09f92571aa87540f0062d7fb2ad: Status 404 returned error can't find the container with id bd720ea0b2305ac182f97e35b1f9b6ab1fc4b09f92571aa87540f0062d7fb2ad
Sep 10 04:33:54.312071 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.312040    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:33:54.592640 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.592606    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:33:54.596143 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:33:54.596114    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5908cf5_dd9c_44ca_ba23_d39104c4c963.slice/crio-b3c152205a5cc4872328bb05d46a060bdf5c5f5dea37f709ef66ef8871009fbf WatchSource:0}: Error finding container b3c152205a5cc4872328bb05d46a060bdf5c5f5dea37f709ef66ef8871009fbf: Status 404 returned error can't find the container with id b3c152205a5cc4872328bb05d46a060bdf5c5f5dea37f709ef66ef8871009fbf
Sep 10 04:33:54.947139 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.946952    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6" event={"ID":"245fec92-534d-47e1-9098-521cc3b7bca1","Type":"ContainerStarted","Data":"569fa4c2bd9c195f9541550cea1afac1d2fb11bb53877e12dc0e83812b97d83a"}
Sep 10 04:33:54.949381 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.949304    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x" event={"ID":"31889ee2-17ab-4050-b0ac-8c14566e0dd6","Type":"ContainerStarted","Data":"bd720ea0b2305ac182f97e35b1f9b6ab1fc4b09f92571aa87540f0062d7fb2ad"}
Sep 10 04:33:54.950809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.950742    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc" event={"ID":"9b84c280-d9ef-4d15-9185-7bd50418b278","Type":"ContainerStarted","Data":"3b6aa1183e0fa90909952708b5bb39d02925105f9595075e913edcfffa8ff8c3"}
Sep 10 04:33:54.954180 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:33:54.954117    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" event={"ID":"d5908cf5-dd9c-44ca-ba23-d39104c4c963","Type":"ContainerStarted","Data":"b3c152205a5cc4872328bb05d46a060bdf5c5f5dea37f709ef66ef8871009fbf"}
Sep 10 04:34:00.702802 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.702770    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:34:00.703287 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.702851    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:34:00.998081 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.997967    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc" event={"ID":"9b84c280-d9ef-4d15-9185-7bd50418b278","Type":"ContainerStarted","Data":"d84a74171ba53bc6e5647cd79270df47cf8e7777bc41f6f593484e49c750bcd3"}
Sep 10 04:34:00.998250 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.998101    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:34:00.999951 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.999902    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" event={"ID":"d5908cf5-dd9c-44ca-ba23-d39104c4c963","Type":"ContainerStarted","Data":"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"}
Sep 10 04:34:01.000125 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:00.999986    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:34:01.001802 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.001773    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6" event={"ID":"245fec92-534d-47e1-9098-521cc3b7bca1","Type":"ContainerStarted","Data":"cc699182c8a8c2779ef28ab1cb8ad3cb3a386d59f54288d60864ed6f23d4a67f"}
Sep 10 04:34:01.003529 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.003504    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x" event={"ID":"31889ee2-17ab-4050-b0ac-8c14566e0dd6","Type":"ContainerStarted","Data":"c9ec5a7157797ad844311586ca1bd253520528a3c655d6c72c83d770da25671d"}
Sep 10 04:34:01.003642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.003629    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:34:01.017312 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.017255    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc" podStartSLOduration=1.476935776 podStartE2EDuration="8.017240404s" totalImagesPullingTime="6.540304628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:01.016486665 +0000 UTC m=+475.234513314" watchObservedRunningTime="2026-09-10 04:34:01.017240404 +0000 UTC m=+475.235267059"
Sep 10 04:34:01.034176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.034093    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x" podStartSLOduration=1.607787819 podStartE2EDuration="8.034072424s" totalImagesPullingTime="6.426284605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:01.033120752 +0000 UTC m=+475.251147428" watchObservedRunningTime="2026-09-10 04:34:01.034072424 +0000 UTC m=+475.252099072"
Sep 10 04:34:01.053262 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.053199    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-dbb8dffb6-dfqx6" podStartSLOduration=2.538259874 podStartE2EDuration="9.053178315s" totalImagesPullingTime="6.514918441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:01.050485894 +0000 UTC m=+475.268512549" watchObservedRunningTime="2026-09-10 04:34:01.053178315 +0000 UTC m=+475.271204989"
Sep 10 04:34:01.082822 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:01.082752    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" podStartSLOduration=1.978658056 podStartE2EDuration="8.082731287s" totalImagesPullingTime="6.104073231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:01.081525456 +0000 UTC m=+475.299552106" watchObservedRunningTime="2026-09-10 04:34:01.082731287 +0000 UTC m=+475.300757938"
Sep 10 04:34:02.010622 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.010573    2526 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-cfkvx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 04:34:02.011101 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.010649    2526 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 04:34:02.225384 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.225350    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"]
Sep 10 04:34:02.228708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.228674    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.231267 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.231241    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pqzrp\""
Sep 10 04:34:02.247836 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.247757    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"]
Sep 10 04:34:02.372991 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.372955    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.372991 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.372993    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373056    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373074    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxv7\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-kube-api-access-ddxv7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373095    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373131    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373192    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373233 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373223    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.373434 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.373252    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474369    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474611 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474458    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474611 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474492    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474611 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474540    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474611 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474595    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474626    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474659    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474718    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.474826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474744    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxv7\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-kube-api-access-ddxv7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.475037 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.474910    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.475094 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.475041    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.475249 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.475191    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.475374 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.475289    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.475697 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.475675    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.477055 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.477037    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.477495 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.477478    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.489736 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.489705    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.492537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.492504    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxv7\" (UniqueName: \"kubernetes.io/projected/b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e-kube-api-access-ddxv7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8\" (UID: \"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.541324 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.541287    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:02.818637 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:02.818602    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"]
Sep 10 04:34:02.821702 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:34:02.821670    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb975cf5a_a6ba_4055_8c78_2e2b3cac8f5e.slice/crio-e34f3e42e4072310526282752635b738d6d87e62475410f98ccf6d34c54ec5c4 WatchSource:0}: Error finding container e34f3e42e4072310526282752635b738d6d87e62475410f98ccf6d34c54ec5c4: Status 404 returned error can't find the container with id e34f3e42e4072310526282752635b738d6d87e62475410f98ccf6d34c54ec5c4
Sep 10 04:34:03.013169 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:03.013133    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8" event={"ID":"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e","Type":"ContainerStarted","Data":"e34f3e42e4072310526282752635b738d6d87e62475410f98ccf6d34c54ec5c4"}
Sep 10 04:34:04.594913 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.594882    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"]
Sep 10 04:34:04.599730 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.599704    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.602267 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.602211    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lxjwq\""
Sep 10 04:34:04.602470 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.602454    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 04:34:04.606341 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.606316    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"]
Sep 10 04:34:04.611993 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.611907    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.612450 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.612204    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"]
Sep 10 04:34:04.615163 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.614980    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 04:34:04.615163 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.615002    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-glvnm\""
Sep 10 04:34:04.627047 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.627018    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"]
Sep 10 04:34:04.691768 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.691735    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b5bad58-114a-46fc-92c1-2d58681669ac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.691989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.691799    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9g9c\" (UniqueName: \"kubernetes.io/projected/12bf9b71-2407-4184-af9b-a2c45210d105-kube-api-access-c9g9c\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.691989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.691885    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.691989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.691968    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb4l\" (UniqueName: \"kubernetes.io/projected/6b5bad58-114a-46fc-92c1-2d58681669ac-kube-api-access-zpb4l\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.792479 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.792441    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9g9c\" (UniqueName: \"kubernetes.io/projected/12bf9b71-2407-4184-af9b-a2c45210d105-kube-api-access-c9g9c\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.792688 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.792491    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.792688 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.792533    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb4l\" (UniqueName: \"kubernetes.io/projected/6b5bad58-114a-46fc-92c1-2d58681669ac-kube-api-access-zpb4l\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.792688 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.792569    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b5bad58-114a-46fc-92c1-2d58681669ac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.792688 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:34:04.792648    2526 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 04:34:04.792882 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:34:04.792713    2526 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert podName:12bf9b71-2407-4184-af9b-a2c45210d105 nodeName:}" failed. No retries permitted until 2026-09-10 04:34:05.292692436 +0000 UTC m=+479.510719067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert") pod "kserve-controller-manager-d6f4b65b8-7v75n" (UID: "12bf9b71-2407-4184-af9b-a2c45210d105") : secret "kserve-webhook-server-cert" not found
Sep 10 04:34:04.795509 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.795481    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b5bad58-114a-46fc-92c1-2d58681669ac-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.818622 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.818560    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb4l\" (UniqueName: \"kubernetes.io/projected/6b5bad58-114a-46fc-92c1-2d58681669ac-kube-api-access-zpb4l\") pod \"llmisvc-controller-manager-777c6bd7d5-2m8xh\" (UID: \"6b5bad58-114a-46fc-92c1-2d58681669ac\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:04.827880 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.827840    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9g9c\" (UniqueName: \"kubernetes.io/projected/12bf9b71-2407-4184-af9b-a2c45210d105-kube-api-access-c9g9c\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:04.924352 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:04.924253    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:05.009728 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.009690    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:34:05.297168 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.297125    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:05.299880 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.299853    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12bf9b71-2407-4184-af9b-a2c45210d105-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v75n\" (UID: \"12bf9b71-2407-4184-af9b-a2c45210d105\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:05.512968 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.512908    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:05.623857 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.622639    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:34:05.623857 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.622736    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:34:05.623857 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.622783    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:34:05.841565 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.841481    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"]
Sep 10 04:34:05.845388 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:05.845146    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"]
Sep 10 04:34:05.849275 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:34:05.848841    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6b5bad58_114a_46fc_92c1_2d58681669ac.slice/crio-75efd1a3e790fe3b5655c92464745fd1d3b1de35eac62357fac30afbd3280985 WatchSource:0}: Error finding container 75efd1a3e790fe3b5655c92464745fd1d3b1de35eac62357fac30afbd3280985: Status 404 returned error can't find the container with id 75efd1a3e790fe3b5655c92464745fd1d3b1de35eac62357fac30afbd3280985
Sep 10 04:34:06.027336 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.027304    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh" event={"ID":"6b5bad58-114a-46fc-92c1-2d58681669ac","Type":"ContainerStarted","Data":"75efd1a3e790fe3b5655c92464745fd1d3b1de35eac62357fac30afbd3280985"}
Sep 10 04:34:06.028487 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.028461    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n" event={"ID":"12bf9b71-2407-4184-af9b-a2c45210d105","Type":"ContainerStarted","Data":"a8402b26c5dac82f0f49ddede53c6806292ac4701a74be26c0aac96e9c86e82b"}
Sep 10 04:34:06.032519 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.032491    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8" event={"ID":"b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e","Type":"ContainerStarted","Data":"ad9925c1efbb0a22d2a3ac00d977b68387eb386326680fe69191edbeeed9530d"}
Sep 10 04:34:06.054359 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.054304    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8" podStartSLOduration=1.255712557 podStartE2EDuration="4.054283829s" totalImagesPullingTime="2.798571272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:34:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:06.05376119 +0000 UTC m=+480.271787859" watchObservedRunningTime="2026-09-10 04:34:06.054283829 +0000 UTC m=+480.272310482"
Sep 10 04:34:06.541698 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.541657    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:06.547283 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.547254    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:06.640985 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.640948    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:34:06.641454 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:06.641204    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerName="discovery" containerID="cri-o://b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6" gracePeriod=30
Sep 10 04:34:07.020185 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.020155    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:34:07.039502 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039454    2526 generic.go:356] "Generic (PLEG): container finished" podID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerID="b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6" exitCode=0
Sep 10 04:34:07.039668 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039513    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"
Sep 10 04:34:07.039668 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039568    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" event={"ID":"d5908cf5-dd9c-44ca-ba23-d39104c4c963","Type":"ContainerDied","Data":"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"}
Sep 10 04:34:07.039668 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039604    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx" event={"ID":"d5908cf5-dd9c-44ca-ba23-d39104c4c963","Type":"ContainerDied","Data":"b3c152205a5cc4872328bb05d46a060bdf5c5f5dea37f709ef66ef8871009fbf"}
Sep 10 04:34:07.039668 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039627    2526 scope.go:117] "RemoveContainer" containerID="b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"
Sep 10 04:34:07.039972 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.039901    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:07.041806 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.041760    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8"
Sep 10 04:34:07.113881 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.113776    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.113881 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.113843    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns29m\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.114194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.113885    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.114194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.113957    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.114194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.114018    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.114194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.114047    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.114194 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.114074    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token\") pod \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\" (UID: \"d5908cf5-dd9c-44ca-ba23-d39104c4c963\") "
Sep 10 04:34:07.118029 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.117991    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:34:07.122696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.122663    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs" (OuterVolumeSpecName: "local-certs") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:34:07.125104 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.125053    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m" (OuterVolumeSpecName: "kube-api-access-ns29m") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "kube-api-access-ns29m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:34:07.125278 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.125229    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:34:07.125360 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.125350    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:34:07.125984 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.125891    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:34:07.127227 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.127196    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts" (OuterVolumeSpecName: "cacerts") pod "d5908cf5-dd9c-44ca-ba23-d39104c4c963" (UID: "d5908cf5-dd9c-44ca-ba23-d39104c4c963"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:34:07.188039 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.187996    2526 scope.go:117] "RemoveContainer" containerID="b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"
Sep 10 04:34:07.188438 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:34:07.188411    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6\": container with ID starting with b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6 not found: ID does not exist" containerID="b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"
Sep 10 04:34:07.188536 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.188445    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6"} err="failed to get container status \"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6\": rpc error: code = NotFound desc = could not find container \"b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6\": container with ID starting with b96407ed8a207fd74e5294e8173d2991ff89559a2357bd2d402964f5e3a431f6 not found: ID does not exist"
Sep 10 04:34:07.218075 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218043    2526 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-token\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218075 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218072    2526 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5908cf5-dd9c-44ca-ba23-d39104c4c963-local-certs\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218075 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218082    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns29m\" (UniqueName: \"kubernetes.io/projected/d5908cf5-dd9c-44ca-ba23-d39104c4c963-kube-api-access-ns29m\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218338 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218094    2526 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-ca-configmap\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218338 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218108    2526 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-cacerts\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218338 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218120    2526 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-kubeconfig\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.218338 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.218130    2526 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d5908cf5-dd9c-44ca-ba23-d39104c4c963-istio-csr-dns-cert\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:34:07.366749 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.366661    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:34:07.371133 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:07.371100    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfkvx"]
Sep 10 04:34:08.304038 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:08.303998    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" path="/var/lib/kubelet/pods/d5908cf5-dd9c-44ca-ba23-d39104c4c963/volumes"
Sep 10 04:34:09.051295 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:09.051255    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh" event={"ID":"6b5bad58-114a-46fc-92c1-2d58681669ac","Type":"ContainerStarted","Data":"7b575b235f06499049b371b69b52180540617eb390470311f207e5e0b4d5ea4f"}
Sep 10 04:34:09.051629 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:09.051355    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:09.052811 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:09.052777    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n" event={"ID":"12bf9b71-2407-4184-af9b-a2c45210d105","Type":"ContainerStarted","Data":"ff2651018076ea36f0db2ea66ab3797b0aa2524e9c57e2df9a6b21b3655f673f"}
Sep 10 04:34:09.099061 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:09.099004    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n" podStartSLOduration=2.265152429 podStartE2EDuration="5.098986662s" totalImagesPullingTime="2.833834233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:09.098812544 +0000 UTC m=+483.316839194" watchObservedRunningTime="2026-09-10 04:34:09.098986662 +0000 UTC m=+483.317013311"
Sep 10 04:34:09.099432 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:09.099410    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh" podStartSLOduration=2.264109428 podStartE2EDuration="5.099404818s" totalImagesPullingTime="2.83529539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:34:09.078640604 +0000 UTC m=+483.296667253" watchObservedRunningTime="2026-09-10 04:34:09.099404818 +0000 UTC m=+483.317431468"
Sep 10 04:34:10.056576 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:10.056541    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:34:12.010788 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:12.010757    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l9h5x"
Sep 10 04:34:12.014016 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:12.013994    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6d6qc"
Sep 10 04:34:40.058543 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:40.058509    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2m8xh"
Sep 10 04:34:41.066210 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:34:41.066183    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v75n"
Sep 10 04:35:15.132505 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.132466    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"]
Sep 10 04:35:15.133033 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.132805    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerName="discovery"
Sep 10 04:35:15.133033 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.132817    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerName="discovery"
Sep 10 04:35:15.133033 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.132873    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5908cf5-dd9c-44ca-ba23-d39104c4c963" containerName="discovery"
Sep 10 04:35:15.137039 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.137016    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.139635 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.139601    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 04:35:15.139635 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.139622    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gpd78\""
Sep 10 04:35:15.139852 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.139614    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 04:35:15.149152 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.149127    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"]
Sep 10 04:35:15.155649 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.155620    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l964x\" (UniqueName: \"kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.155781 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.155666    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.256740 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.256706    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l964x\" (UniqueName: \"kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.256904 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.256751    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.257118 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.257091    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.265836 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.265811    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l964x\" (UniqueName: \"kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.447761 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.447673    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:15.725239 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:15.725154    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"]
Sep 10 04:35:15.730043 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:15.730006    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9e372b_a2b5_4081_bad7_d6f404a56df9.slice/crio-186f86dc61126a25194b605e0f782a7d51f5cf8a32cd4ab410ad30a11bc59104 WatchSource:0}: Error finding container 186f86dc61126a25194b605e0f782a7d51f5cf8a32cd4ab410ad30a11bc59104: Status 404 returned error can't find the container with id 186f86dc61126a25194b605e0f782a7d51f5cf8a32cd4ab410ad30a11bc59104
Sep 10 04:35:16.325992 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:16.325917    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v" event={"ID":"ba9e372b-a2b5-4081-bad7-d6f404a56df9","Type":"ContainerStarted","Data":"186f86dc61126a25194b605e0f782a7d51f5cf8a32cd4ab410ad30a11bc59104"}
Sep 10 04:35:17.641449 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.641402    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hhgxc"]
Sep 10 04:35:17.652429 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.652396    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:17.655614 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.655428    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-75jnq\""
Sep 10 04:35:17.657218 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.657057    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hhgxc"]
Sep 10 04:35:17.677460 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.677428    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf28c\" (UniqueName: \"kubernetes.io/projected/22ca113f-724c-4121-afe4-c1429d7bd8c8-kube-api-access-vf28c\") pod \"authorino-operator-76b478bd78-hhgxc\" (UID: \"22ca113f-724c-4121-afe4-c1429d7bd8c8\") " pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:17.778538 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.778506    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf28c\" (UniqueName: \"kubernetes.io/projected/22ca113f-724c-4121-afe4-c1429d7bd8c8-kube-api-access-vf28c\") pod \"authorino-operator-76b478bd78-hhgxc\" (UID: \"22ca113f-724c-4121-afe4-c1429d7bd8c8\") " pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:17.788600 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.788573    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf28c\" (UniqueName: \"kubernetes.io/projected/22ca113f-724c-4121-afe4-c1429d7bd8c8-kube-api-access-vf28c\") pod \"authorino-operator-76b478bd78-hhgxc\" (UID: \"22ca113f-724c-4121-afe4-c1429d7bd8c8\") " pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:17.968319 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:17.968235    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:18.261298 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:18.261213    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hhgxc"]
Sep 10 04:35:18.264810 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:18.264779    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ca113f_724c_4121_afe4_c1429d7bd8c8.slice/crio-60a249369d1215ee2cb95bbe0a24f245967075937cf790ca34a3a46523f5edb2 WatchSource:0}: Error finding container 60a249369d1215ee2cb95bbe0a24f245967075937cf790ca34a3a46523f5edb2: Status 404 returned error can't find the container with id 60a249369d1215ee2cb95bbe0a24f245967075937cf790ca34a3a46523f5edb2
Sep 10 04:35:18.337080 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:18.337041    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc" event={"ID":"22ca113f-724c-4121-afe4-c1429d7bd8c8","Type":"ContainerStarted","Data":"60a249369d1215ee2cb95bbe0a24f245967075937cf790ca34a3a46523f5edb2"}
Sep 10 04:35:19.786826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.786792    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"]
Sep 10 04:35:19.790627 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.790605    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:19.793578 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.793553    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kfs6d\""
Sep 10 04:35:19.793700 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.793556    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 04:35:19.810044 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.810013    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"]
Sep 10 04:35:19.896321 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.896285    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66krj\" (UniqueName: \"kubernetes.io/projected/c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3-kube-api-access-66krj\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlxk7\" (UID: \"c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:19.997740 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:19.997714    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66krj\" (UniqueName: \"kubernetes.io/projected/c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3-kube-api-access-66krj\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlxk7\" (UID: \"c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:20.014033 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.014010    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66krj\" (UniqueName: \"kubernetes.io/projected/c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3-kube-api-access-66krj\") pod \"dns-operator-controller-manager-7b84cd7c9c-rlxk7\" (UID: \"c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:20.104405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.104371    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:20.348670 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.348640    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v" event={"ID":"ba9e372b-a2b5-4081-bad7-d6f404a56df9","Type":"ContainerStarted","Data":"42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7"}
Sep 10 04:35:20.348825 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.348717    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:20.371959 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.371842    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v" podStartSLOduration=1.15360711 podStartE2EDuration="5.371819896s" totalImagesPullingTime="4.218212786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:20.370871903 +0000 UTC m=+554.588898573" watchObservedRunningTime="2026-09-10 04:35:20.371819896 +0000 UTC m=+554.589846547"
Sep 10 04:35:20.390363 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:20.390255    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"]
Sep 10 04:35:20.609519 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:20.609483    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a3ca9b_3a14_4a18_92e7_c98c8dcef8b3.slice/crio-65b37d9132cfe65f230090d7d84a041d25235340148d4142f496cb2ea20bab7a WatchSource:0}: Error finding container 65b37d9132cfe65f230090d7d84a041d25235340148d4142f496cb2ea20bab7a: Status 404 returned error can't find the container with id 65b37d9132cfe65f230090d7d84a041d25235340148d4142f496cb2ea20bab7a
Sep 10 04:35:21.355190 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.355155    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc" event={"ID":"22ca113f-724c-4121-afe4-c1429d7bd8c8","Type":"ContainerStarted","Data":"5b5dd215a5025dfea1c86cf68267dbc39e9f016d8b279c2e560ab7b7a6a572f1"}
Sep 10 04:35:21.355674 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.355285    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:21.356663 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.356639    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7" event={"ID":"c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3","Type":"ContainerStarted","Data":"65b37d9132cfe65f230090d7d84a041d25235340148d4142f496cb2ea20bab7a"}
Sep 10 04:35:21.374413 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.374359    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc" podStartSLOduration=1.977711156 podStartE2EDuration="4.374343008s" totalImagesPullingTime="2.396631852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:21.373674541 +0000 UTC m=+555.591701195" watchObservedRunningTime="2026-09-10 04:35:21.374343008 +0000 UTC m=+555.592369663"
Sep 10 04:35:21.989832 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.989798    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"]
Sep 10 04:35:21.993094 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.993074    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:21.995711 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:21.995690    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-q266m\""
Sep 10 04:35:22.009503 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.009469    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"]
Sep 10 04:35:22.114479 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.114435    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tcf\" (UniqueName: \"kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf\") pod \"limitador-operator-controller-manager-74495c69f8-mrm7w\" (UID: \"11d1ca4a-a51f-4d75-841f-3c3a7312e191\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:22.215746 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.215700    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tcf\" (UniqueName: \"kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf\") pod \"limitador-operator-controller-manager-74495c69f8-mrm7w\" (UID: \"11d1ca4a-a51f-4d75-841f-3c3a7312e191\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:22.224689 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.224663    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tcf\" (UniqueName: \"kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf\") pod \"limitador-operator-controller-manager-74495c69f8-mrm7w\" (UID: \"11d1ca4a-a51f-4d75-841f-3c3a7312e191\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:22.305584 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.305551    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:22.594524 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:22.594288    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"]
Sep 10 04:35:22.823875 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:22.823839    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d1ca4a_a51f_4d75_841f_3c3a7312e191.slice/crio-1e6114845e5743e3307b8bf8ca52f93a6a68f5c0e48639995217371830345ae6 WatchSource:0}: Error finding container 1e6114845e5743e3307b8bf8ca52f93a6a68f5c0e48639995217371830345ae6: Status 404 returned error can't find the container with id 1e6114845e5743e3307b8bf8ca52f93a6a68f5c0e48639995217371830345ae6
Sep 10 04:35:23.119819 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.119782    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"]
Sep 10 04:35:23.122988 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.122961    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.125655 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.125634    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 04:35:23.126086 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.126070    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 04:35:23.126424 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.126406    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jr9x6\""
Sep 10 04:35:23.132279 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.132256    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"]
Sep 10 04:35:23.224463 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.224424    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zcsb\" (UniqueName: \"kubernetes.io/projected/1c92b2e3-5c21-43c4-8d78-4678a32468ba-kube-api-access-8zcsb\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.224463 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.224465    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c92b2e3-5c21-43c4-8d78-4678a32468ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.224663 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.224488    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c92b2e3-5c21-43c4-8d78-4678a32468ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.325207 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.325174    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zcsb\" (UniqueName: \"kubernetes.io/projected/1c92b2e3-5c21-43c4-8d78-4678a32468ba-kube-api-access-8zcsb\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.325207 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.325212    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c92b2e3-5c21-43c4-8d78-4678a32468ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.325458 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.325238    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c92b2e3-5c21-43c4-8d78-4678a32468ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.326016 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.325992    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1c92b2e3-5c21-43c4-8d78-4678a32468ba-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.327639 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.327619    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1c92b2e3-5c21-43c4-8d78-4678a32468ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.341005 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.340975    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zcsb\" (UniqueName: \"kubernetes.io/projected/1c92b2e3-5c21-43c4-8d78-4678a32468ba-kube-api-access-8zcsb\") pod \"kuadrant-console-plugin-fbdd4f445-nlrl5\" (UID: \"1c92b2e3-5c21-43c4-8d78-4678a32468ba\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.367810 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.367773    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w" event={"ID":"11d1ca4a-a51f-4d75-841f-3c3a7312e191","Type":"ContainerStarted","Data":"1e6114845e5743e3307b8bf8ca52f93a6a68f5c0e48639995217371830345ae6"}
Sep 10 04:35:23.369298 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.369272    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7" event={"ID":"c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3","Type":"ContainerStarted","Data":"910b3c4596730acefa419a2badede8d8fb110a6b01d16a30cab318331a54e8c5"}
Sep 10 04:35:23.369435 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.369377    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:23.419410 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.419314    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7" podStartSLOduration=2.151795063 podStartE2EDuration="4.419299283s" totalImagesPullingTime="2.26750422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:23.416559246 +0000 UTC m=+557.634585895" watchObservedRunningTime="2026-09-10 04:35:23.419299283 +0000 UTC m=+557.637325927"
Sep 10 04:35:23.432270 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.432244    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"
Sep 10 04:35:23.701317 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:23.701242    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5"]
Sep 10 04:35:23.704045 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:23.704014    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c92b2e3_5c21_43c4_8d78_4678a32468ba.slice/crio-6a14d2705ea45c17c4f354e331039922993bcd9060f7ec0489dd9b3c2ff4b427 WatchSource:0}: Error finding container 6a14d2705ea45c17c4f354e331039922993bcd9060f7ec0489dd9b3c2ff4b427: Status 404 returned error can't find the container with id 6a14d2705ea45c17c4f354e331039922993bcd9060f7ec0489dd9b3c2ff4b427
Sep 10 04:35:24.375174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:24.375134    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5" event={"ID":"1c92b2e3-5c21-43c4-8d78-4678a32468ba","Type":"ContainerStarted","Data":"6a14d2705ea45c17c4f354e331039922993bcd9060f7ec0489dd9b3c2ff4b427"}
Sep 10 04:35:25.382615 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:25.382573    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w" event={"ID":"11d1ca4a-a51f-4d75-841f-3c3a7312e191","Type":"ContainerStarted","Data":"665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770"}
Sep 10 04:35:25.383084 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:25.382740    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:25.398905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:25.398852    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w" podStartSLOduration=2.621829145 podStartE2EDuration="4.398833104s" totalImagesPullingTime="1.777003959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:25.396914713 +0000 UTC m=+559.614941359" watchObservedRunningTime="2026-09-10 04:35:25.398833104 +0000 UTC m=+559.616859756"
Sep 10 04:35:29.400879 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:29.400843    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5" event={"ID":"1c92b2e3-5c21-43c4-8d78-4678a32468ba","Type":"ContainerStarted","Data":"51e049688bba8cee714df1a9008594e30c609ad7a72929ddcff7a2de50a14d5f"}
Sep 10 04:35:29.420027 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:29.419974    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-nlrl5" podStartSLOduration=1.685312493 podStartE2EDuration="6.419959266s" totalImagesPullingTime="4.734646773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:29.417870958 +0000 UTC m=+563.635897605" watchObservedRunningTime="2026-09-10 04:35:29.419959266 +0000 UTC m=+563.637985963"
Sep 10 04:35:31.359697 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:31.359659    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:32.363733 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:32.363701    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hhgxc"
Sep 10 04:35:33.700708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.700671    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"]
Sep 10 04:35:33.701164 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.700864    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" containerName="manager" containerID="cri-o://42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7" gracePeriod=2
Sep 10 04:35:33.711039 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.710993    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"]
Sep 10 04:35:33.732438 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.732412    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"]
Sep 10 04:35:33.732607 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.732584    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" containerName="manager" containerID="cri-o://665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770" gracePeriod=2
Sep 10 04:35:33.734442 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.734418    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.750364 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.750328    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"]
Sep 10 04:35:33.750592 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.750564    2526 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"11d1ca4a-a51f-4d75-841f-3c3a7312e191\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-mrm7w\": pods \"limitador-operator-controller-manager-74495c69f8-mrm7w\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.752515 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.752482    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.755811 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.755785    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.757498 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.757476    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mrm7w\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.782144 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782120    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:33.782546 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782532    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" containerName="manager"
Sep 10 04:35:33.782588 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782550    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" containerName="manager"
Sep 10 04:35:33.782588 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782571    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" containerName="manager"
Sep 10 04:35:33.782588 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782580    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" containerName="manager"
Sep 10 04:35:33.782674 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782659    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" containerName="manager"
Sep 10 04:35:33.782674 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.782671    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" containerName="manager"
Sep 10 04:35:33.785693 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.785676    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:33.788079 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.788049    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.789835 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.789811    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mrm7w\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.805504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.805480    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:33.920433 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.920394    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:33.920599 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.920512    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbkd\" (UniqueName: \"kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:33.986943 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.986909    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.989149 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.989122    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.989515 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:33.989495    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.991102 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.991082    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mrm7w\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:33.993100 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.993081    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zlx7v\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:33.996371 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:33.996353    2526 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mrm7w\" is forbidden: User \"system:node:ip-10-0-137-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-116.ec2.internal' and this object" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:34.021624 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.021593    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbkd\" (UniqueName: \"kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:34.021733 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.021647    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:34.022074 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.022055    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:34.045619 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.045596    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbkd\" (UniqueName: \"kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd\") pod \"kuadrant-operator-controller-manager-76f8f686bf-mx74p\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:34.122895 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.122860    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6tcf\" (UniqueName: \"kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf\") pod \"11d1ca4a-a51f-4d75-841f-3c3a7312e191\" (UID: \"11d1ca4a-a51f-4d75-841f-3c3a7312e191\") "
Sep 10 04:35:34.122895 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.122897    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l964x\" (UniqueName: \"kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x\") pod \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") "
Sep 10 04:35:34.123107 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.122974    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume\") pod \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\" (UID: \"ba9e372b-a2b5-4081-bad7-d6f404a56df9\") "
Sep 10 04:35:34.123653 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.123622    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba9e372b-a2b5-4081-bad7-d6f404a56df9" (UID: "ba9e372b-a2b5-4081-bad7-d6f404a56df9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:35:34.125032 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.125013    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf" (OuterVolumeSpecName: "kube-api-access-d6tcf") pod "11d1ca4a-a51f-4d75-841f-3c3a7312e191" (UID: "11d1ca4a-a51f-4d75-841f-3c3a7312e191"). InnerVolumeSpecName "kube-api-access-d6tcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:35:34.125090 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.125044    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x" (OuterVolumeSpecName: "kube-api-access-l964x") pod "ba9e372b-a2b5-4081-bad7-d6f404a56df9" (UID: "ba9e372b-a2b5-4081-bad7-d6f404a56df9"). InnerVolumeSpecName "kube-api-access-l964x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:35:34.134330 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.134313    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:34.224484 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.224398    2526 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba9e372b-a2b5-4081-bad7-d6f404a56df9-extensions-socket-volume\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:35:34.224484 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.224430    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6tcf\" (UniqueName: \"kubernetes.io/projected/11d1ca4a-a51f-4d75-841f-3c3a7312e191-kube-api-access-d6tcf\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:35:34.224484 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.224443    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l964x\" (UniqueName: \"kubernetes.io/projected/ba9e372b-a2b5-4081-bad7-d6f404a56df9-kube-api-access-l964x\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:35:34.306300 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.306263    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" path="/var/lib/kubelet/pods/11d1ca4a-a51f-4d75-841f-3c3a7312e191/volumes"
Sep 10 04:35:34.306612 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.306599    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" path="/var/lib/kubelet/pods/ba9e372b-a2b5-4081-bad7-d6f404a56df9/volumes"
Sep 10 04:35:34.377746 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.377709    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rlxk7"
Sep 10 04:35:34.424447 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.424406    2526 generic.go:356] "Generic (PLEG): container finished" podID="ba9e372b-a2b5-4081-bad7-d6f404a56df9" containerID="42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7" exitCode=0
Sep 10 04:35:34.424590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.424456    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zlx7v"
Sep 10 04:35:34.424590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.424493    2526 scope.go:117] "RemoveContainer" containerID="42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7"
Sep 10 04:35:34.426493 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.426469    2526 generic.go:356] "Generic (PLEG): container finished" podID="11d1ca4a-a51f-4d75-841f-3c3a7312e191" containerID="665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770" exitCode=0
Sep 10 04:35:34.426605 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.426527    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mrm7w"
Sep 10 04:35:34.432989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.432971    2526 scope.go:117] "RemoveContainer" containerID="42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7"
Sep 10 04:35:34.433244 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:34.433225    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7\": container with ID starting with 42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7 not found: ID does not exist" containerID="42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7"
Sep 10 04:35:34.433311 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.433250    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7"} err="failed to get container status \"42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7\": rpc error: code = NotFound desc = could not find container \"42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7\": container with ID starting with 42c1517cb8af56a439f78c8c4156d4e0d745b6b406035246d5f05c1328c69bc7 not found: ID does not exist"
Sep 10 04:35:34.433311 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.433266    2526 scope.go:117] "RemoveContainer" containerID="665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770"
Sep 10 04:35:34.440902 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.440885    2526 scope.go:117] "RemoveContainer" containerID="665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770"
Sep 10 04:35:34.441251 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:34.441208    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770\": container with ID starting with 665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770 not found: ID does not exist" containerID="665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770"
Sep 10 04:35:34.441327 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.441242    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770"} err="failed to get container status \"665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770\": rpc error: code = NotFound desc = could not find container \"665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770\": container with ID starting with 665582b4865f0b346b2f99d68e41d9c2366258df0bd6f5c906c8585e9dd94770 not found: ID does not exist"
Sep 10 04:35:34.443306 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:34.443285    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:34.445565 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:34.445541    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f000e4_163c_48a9_a589_b40306b3657e.slice/crio-2a16936614f5154a7b33ad2d63c3238b772952656d34b9db721690276832eb73 WatchSource:0}: Error finding container 2a16936614f5154a7b33ad2d63c3238b772952656d34b9db721690276832eb73: Status 404 returned error can't find the container with id 2a16936614f5154a7b33ad2d63c3238b772952656d34b9db721690276832eb73
Sep 10 04:35:35.361861 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.361826    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"]
Sep 10 04:35:35.365322 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.365299    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.384209 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.384182    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"]
Sep 10 04:35:35.433977 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.433943    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" event={"ID":"24f000e4-163c-48a9-a589-b40306b3657e","Type":"ContainerStarted","Data":"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"}
Sep 10 04:35:35.434174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.434002    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" event={"ID":"24f000e4-163c-48a9-a589-b40306b3657e","Type":"ContainerStarted","Data":"2a16936614f5154a7b33ad2d63c3238b772952656d34b9db721690276832eb73"}
Sep 10 04:35:35.434174 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.434065    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:35.434653 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.434632    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb9bd998-acf7-4a8e-b594-c778f5030f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.434721 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.434662    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzgw\" (UniqueName: \"kubernetes.io/projected/cb9bd998-acf7-4a8e-b594-c778f5030f9b-kube-api-access-knzgw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.470900 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.470837    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" podStartSLOduration=2.470815391 podStartE2EDuration="2.470815391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:35.468578418 +0000 UTC m=+569.686605110" watchObservedRunningTime="2026-09-10 04:35:35.470815391 +0000 UTC m=+569.688842042"
Sep 10 04:35:35.535743 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.535705    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb9bd998-acf7-4a8e-b594-c778f5030f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.535743 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.535740    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzgw\" (UniqueName: \"kubernetes.io/projected/cb9bd998-acf7-4a8e-b594-c778f5030f9b-kube-api-access-knzgw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.536169 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.536146    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb9bd998-acf7-4a8e-b594-c778f5030f9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.561051 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.561027    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzgw\" (UniqueName: \"kubernetes.io/projected/cb9bd998-acf7-4a8e-b594-c778f5030f9b-kube-api-access-knzgw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-lgcnp\" (UID: \"cb9bd998-acf7-4a8e-b594-c778f5030f9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.675302 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.675215    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:35.967687 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:35.967615    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"]
Sep 10 04:35:35.973274 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:35:35.973245    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9bd998_acf7_4a8e_b594_c778f5030f9b.slice/crio-f9c739f75618c5fd6c94a1edf2d26b5e41a215847168d9e63612af674aae4318 WatchSource:0}: Error finding container f9c739f75618c5fd6c94a1edf2d26b5e41a215847168d9e63612af674aae4318: Status 404 returned error can't find the container with id f9c739f75618c5fd6c94a1edf2d26b5e41a215847168d9e63612af674aae4318
Sep 10 04:35:36.441231 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:36.441195    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp" event={"ID":"cb9bd998-acf7-4a8e-b594-c778f5030f9b","Type":"ContainerStarted","Data":"0d28fa09c23ea5ade8ca16192fa589067d8a76fbe56ac3b2214e1e9861566f95"}
Sep 10 04:35:36.441712 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:36.441254    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp" event={"ID":"cb9bd998-acf7-4a8e-b594-c778f5030f9b","Type":"ContainerStarted","Data":"f9c739f75618c5fd6c94a1edf2d26b5e41a215847168d9e63612af674aae4318"}
Sep 10 04:35:36.441712 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:36.441417    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:36.477969 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:36.477901    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp" podStartSLOduration=1.4778789190000001 podStartE2EDuration="1.477878919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:35:36.477264983 +0000 UTC m=+570.695291651" watchObservedRunningTime="2026-09-10 04:35:36.477878919 +0000 UTC m=+570.695905582"
Sep 10 04:35:46.444144 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:46.444106    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:47.447957 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:47.447901    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-lgcnp"
Sep 10 04:35:47.504913 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:47.504880    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:47.505153 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:47.505128    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" podUID="24f000e4-163c-48a9-a589-b40306b3657e" containerName="manager" containerID="cri-o://86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564" gracePeriod=10
Sep 10 04:35:48.285612 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.285581    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:48.446605 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.446510    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume\") pod \"24f000e4-163c-48a9-a589-b40306b3657e\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") "
Sep 10 04:35:48.446605 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.446595    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdbkd\" (UniqueName: \"kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd\") pod \"24f000e4-163c-48a9-a589-b40306b3657e\" (UID: \"24f000e4-163c-48a9-a589-b40306b3657e\") "
Sep 10 04:35:48.446887 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.446863    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "24f000e4-163c-48a9-a589-b40306b3657e" (UID: "24f000e4-163c-48a9-a589-b40306b3657e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 04:35:48.448576 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.448553    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd" (OuterVolumeSpecName: "kube-api-access-fdbkd") pod "24f000e4-163c-48a9-a589-b40306b3657e" (UID: "24f000e4-163c-48a9-a589-b40306b3657e"). InnerVolumeSpecName "kube-api-access-fdbkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:35:48.495544 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.495507    2526 generic.go:356] "Generic (PLEG): container finished" podID="24f000e4-163c-48a9-a589-b40306b3657e" containerID="86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564" exitCode=0
Sep 10 04:35:48.495708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.495552    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"
Sep 10 04:35:48.495708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.495555    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" event={"ID":"24f000e4-163c-48a9-a589-b40306b3657e","Type":"ContainerDied","Data":"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"}
Sep 10 04:35:48.495708 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.495683    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p" event={"ID":"24f000e4-163c-48a9-a589-b40306b3657e","Type":"ContainerDied","Data":"2a16936614f5154a7b33ad2d63c3238b772952656d34b9db721690276832eb73"}
Sep 10 04:35:48.495809 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.495712    2526 scope.go:117] "RemoveContainer" containerID="86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"
Sep 10 04:35:48.504092 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.504058    2526 scope.go:117] "RemoveContainer" containerID="86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"
Sep 10 04:35:48.504347 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:35:48.504330    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564\": container with ID starting with 86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564 not found: ID does not exist" containerID="86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"
Sep 10 04:35:48.504394 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.504356    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564"} err="failed to get container status \"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564\": rpc error: code = NotFound desc = could not find container \"86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564\": container with ID starting with 86abbb5bf5246ee0fe788160d519a2bfe3cda30f1743d0b66e28026ace524564 not found: ID does not exist"
Sep 10 04:35:48.535519 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.535484    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:48.536763 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.536741    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-mx74p"]
Sep 10 04:35:48.547608 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.547579    2526 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24f000e4-163c-48a9-a589-b40306b3657e-extensions-socket-volume\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:35:48.547608 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:48.547605    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbkd\" (UniqueName: \"kubernetes.io/projected/24f000e4-163c-48a9-a589-b40306b3657e-kube-api-access-fdbkd\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:35:50.303179 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:35:50.303145    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f000e4-163c-48a9-a589-b40306b3657e" path="/var/lib/kubelet/pods/24f000e4-163c-48a9-a589-b40306b3657e/volumes"
Sep 10 04:36:03.825213 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.825181    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"]
Sep 10 04:36:03.825633 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.825465    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24f000e4-163c-48a9-a589-b40306b3657e" containerName="manager"
Sep 10 04:36:03.825633 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.825476    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f000e4-163c-48a9-a589-b40306b3657e" containerName="manager"
Sep 10 04:36:03.825633 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.825537    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="24f000e4-163c-48a9-a589-b40306b3657e" containerName="manager"
Sep 10 04:36:03.828410 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.828392    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.830521 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.830500    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wq9mk\""
Sep 10 04:36:03.838747 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.838718    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"]
Sep 10 04:36:03.866267 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866231    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866276    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866300    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224073-c872-4142-9df3-5b4ad6448635-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866430 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866362    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szfnb\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-kube-api-access-szfnb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866569 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866428    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866569 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866470    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224073-c872-4142-9df3-5b4ad6448635-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866643    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866691    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.866723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.866717    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967259 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967216    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224073-c872-4142-9df3-5b4ad6448635-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967282    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967311    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967325    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967346    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967376    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967405    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224073-c872-4142-9df3-5b4ad6448635-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967443 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967426    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szfnb\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-kube-api-access-szfnb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967766 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967454    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967821 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967777    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967904 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967869    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967984 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967897    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.967984 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.967924    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.968150 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.968128    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224073-c872-4142-9df3-5b4ad6448635-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.969936 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.969907    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224073-c872-4142-9df3-5b4ad6448635-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.970090 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.970074    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224073-c872-4142-9df3-5b4ad6448635-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.974692 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.974670    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:03.974948 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:03.974917    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szfnb\" (UniqueName: \"kubernetes.io/projected/b5224073-c872-4142-9df3-5b4ad6448635-kube-api-access-szfnb\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vkzk9\" (UID: \"b5224073-c872-4142-9df3-5b4ad6448635\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:04.138231 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.138147    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:04.412755 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.412678    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"]
Sep 10 04:36:04.415892 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:04.415865    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5224073_c872_4142_9df3_5b4ad6448635.slice/crio-da3dd867b67782465a9d949a4c06d37a3a551430dc27d6d0efde9344d48b03c4 WatchSource:0}: Error finding container da3dd867b67782465a9d949a4c06d37a3a551430dc27d6d0efde9344d48b03c4: Status 404 returned error can't find the container with id da3dd867b67782465a9d949a4c06d37a3a551430dc27d6d0efde9344d48b03c4
Sep 10 04:36:04.417892 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.417853    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:36:04.417987 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.417974    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:36:04.418037 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.418016    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:36:04.569109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.569072    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" event={"ID":"b5224073-c872-4142-9df3-5b4ad6448635","Type":"ContainerStarted","Data":"0db14fa1a5594949de9fc1a29732d9125fb43f08094d4c0fa6cbd4991b6bdf19"}
Sep 10 04:36:04.569339 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.569121    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" event={"ID":"b5224073-c872-4142-9df3-5b4ad6448635","Type":"ContainerStarted","Data":"da3dd867b67782465a9d949a4c06d37a3a551430dc27d6d0efde9344d48b03c4"}
Sep 10 04:36:04.592236 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:04.592180    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podStartSLOduration=1.592161514 podStartE2EDuration="1.592161514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:04.590721416 +0000 UTC m=+598.808748078" watchObservedRunningTime="2026-09-10 04:36:04.592161514 +0000 UTC m=+598.810188165"
Sep 10 04:36:05.138639 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.138601    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:05.143458 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.143436    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:05.573674 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.573644    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:05.574474 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.574454    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:36:05.602237 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.602203    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:05.605460 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.605438    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.607734 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.607714    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 10 04:36:05.616721 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.616694    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:05.680144 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.680109    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.680427 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.680401    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbf5c\" (UniqueName: \"kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.703360 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.703331    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:05.781127 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.781091    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.781309 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.781150    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5c\" (UniqueName: \"kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.781700 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.781680    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.789371 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.789340    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbf5c\" (UniqueName: \"kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c\") pod \"limitador-limitador-8588749977-gqf4s\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") " pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:05.918156 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:05.918064    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:06.187683 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.187606    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:06.190638 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:06.190606    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049bc331_80aa_4a76_b95f_8d0c96bcb369.slice/crio-bed323ced87f25aa006f53c8f861e73d96a6e27a7510fa6350ac308d483cebad WatchSource:0}: Error finding container bed323ced87f25aa006f53c8f861e73d96a6e27a7510fa6350ac308d483cebad: Status 404 returned error can't find the container with id bed323ced87f25aa006f53c8f861e73d96a6e27a7510fa6350ac308d483cebad
Sep 10 04:36:06.397133 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.397068    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:06.402164 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.402141    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:06.404367 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.404328    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zqvjc\""
Sep 10 04:36:06.409725 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.409709    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:06.487161 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.487061    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjxwt\" (UniqueName: \"kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt\") pod \"authorino-7bcfd8f9cd-sjh4z\" (UID: \"f7ce530b-ca70-4005-bca9-a225d1a22658\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:06.579345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.579304    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" event={"ID":"049bc331-80aa-4a76-b95f-8d0c96bcb369","Type":"ContainerStarted","Data":"bed323ced87f25aa006f53c8f861e73d96a6e27a7510fa6350ac308d483cebad"}
Sep 10 04:36:06.588166 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.588134    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjxwt\" (UniqueName: \"kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt\") pod \"authorino-7bcfd8f9cd-sjh4z\" (UID: \"f7ce530b-ca70-4005-bca9-a225d1a22658\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:06.595215 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.595192    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjxwt\" (UniqueName: \"kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt\") pod \"authorino-7bcfd8f9cd-sjh4z\" (UID: \"f7ce530b-ca70-4005-bca9-a225d1a22658\") " pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:06.712444 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.712401    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:06.998441 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:06.998406    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:07.001019 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:07.000991    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7ce530b_ca70_4005_bca9_a225d1a22658.slice/crio-6eafc9612535d57891576c2259d80028b4f1531eeb4761261e3d2e1a970a7fb7 WatchSource:0}: Error finding container 6eafc9612535d57891576c2259d80028b4f1531eeb4761261e3d2e1a970a7fb7: Status 404 returned error can't find the container with id 6eafc9612535d57891576c2259d80028b4f1531eeb4761261e3d2e1a970a7fb7
Sep 10 04:36:07.585860 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:07.585825    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" event={"ID":"049bc331-80aa-4a76-b95f-8d0c96bcb369","Type":"ContainerStarted","Data":"e4d1a1425c530f57f3ad795273c4b8a8be03c2ebcacea503411fc81882caaccc"}
Sep 10 04:36:07.586345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:07.586076    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:07.587154 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:07.587116    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" event={"ID":"f7ce530b-ca70-4005-bca9-a225d1a22658","Type":"ContainerStarted","Data":"6eafc9612535d57891576c2259d80028b4f1531eeb4761261e3d2e1a970a7fb7"}
Sep 10 04:36:07.601748 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:07.601700    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" podStartSLOduration=1.365996683 podStartE2EDuration="2.60168315s" totalImagesPullingTime="1.235686467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:07.600633853 +0000 UTC m=+601.818660503" watchObservedRunningTime="2026-09-10 04:36:07.60168315 +0000 UTC m=+601.819709799"
Sep 10 04:36:09.602822 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:09.602775    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" event={"ID":"f7ce530b-ca70-4005-bca9-a225d1a22658","Type":"ContainerStarted","Data":"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"}
Sep 10 04:36:09.617574 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:09.617532    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" podStartSLOduration=1.5598435560000001 podStartE2EDuration="3.617517885s" totalImagesPullingTime="2.057674329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:09.61683979 +0000 UTC m=+603.834866457" watchObservedRunningTime="2026-09-10 04:36:09.617517885 +0000 UTC m=+603.835544533"
Sep 10 04:36:15.207014 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.206978    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:15.207439 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.207180    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" podUID="f7ce530b-ca70-4005-bca9-a225d1a22658" containerName="authorino" containerID="cri-o://24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b" gracePeriod=30
Sep 10 04:36:15.452946 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.452905    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:15.562687 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.562653    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjxwt\" (UniqueName: \"kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt\") pod \"f7ce530b-ca70-4005-bca9-a225d1a22658\" (UID: \"f7ce530b-ca70-4005-bca9-a225d1a22658\") "
Sep 10 04:36:15.564758 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.564733    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt" (OuterVolumeSpecName: "kube-api-access-mjxwt") pod "f7ce530b-ca70-4005-bca9-a225d1a22658" (UID: "f7ce530b-ca70-4005-bca9-a225d1a22658"). InnerVolumeSpecName "kube-api-access-mjxwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:36:15.633390 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.633350    2526 generic.go:356] "Generic (PLEG): container finished" podID="f7ce530b-ca70-4005-bca9-a225d1a22658" containerID="24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b" exitCode=0
Sep 10 04:36:15.633390 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.633385    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z"
Sep 10 04:36:15.633625 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.633433    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" event={"ID":"f7ce530b-ca70-4005-bca9-a225d1a22658","Type":"ContainerDied","Data":"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"}
Sep 10 04:36:15.633625 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.633479    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-sjh4z" event={"ID":"f7ce530b-ca70-4005-bca9-a225d1a22658","Type":"ContainerDied","Data":"6eafc9612535d57891576c2259d80028b4f1531eeb4761261e3d2e1a970a7fb7"}
Sep 10 04:36:15.633625 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.633497    2526 scope.go:117] "RemoveContainer" containerID="24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"
Sep 10 04:36:15.641579 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.641562    2526 scope.go:117] "RemoveContainer" containerID="24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"
Sep 10 04:36:15.641836 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:36:15.641816    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b\": container with ID starting with 24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b not found: ID does not exist" containerID="24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"
Sep 10 04:36:15.641903 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.641844    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b"} err="failed to get container status \"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b\": rpc error: code = NotFound desc = could not find container \"24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b\": container with ID starting with 24f4b04dca6888df72b9430f8356eacc35f93bc9e12243a5bd8bca567a82a89b not found: ID does not exist"
Sep 10 04:36:15.653195 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.653171    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:15.657242 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.657223    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-sjh4z"]
Sep 10 04:36:15.663846 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:15.663830    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjxwt\" (UniqueName: \"kubernetes.io/projected/f7ce530b-ca70-4005-bca9-a225d1a22658-kube-api-access-mjxwt\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:16.302909 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:16.302867    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7ce530b-ca70-4005-bca9-a225d1a22658" path="/var/lib/kubelet/pods/f7ce530b-ca70-4005-bca9-a225d1a22658/volumes"
Sep 10 04:36:18.593784 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:18.593755    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:20.243502 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:20.243471    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:20.243902 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:20.243669    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" podUID="049bc331-80aa-4a76-b95f-8d0c96bcb369" containerName="limitador" containerID="cri-o://e4d1a1425c530f57f3ad795273c4b8a8be03c2ebcacea503411fc81882caaccc" gracePeriod=30
Sep 10 04:36:20.659417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:20.659380    2526 generic.go:356] "Generic (PLEG): container finished" podID="049bc331-80aa-4a76-b95f-8d0c96bcb369" containerID="e4d1a1425c530f57f3ad795273c4b8a8be03c2ebcacea503411fc81882caaccc" exitCode=0
Sep 10 04:36:20.659574 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:20.659422    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" event={"ID":"049bc331-80aa-4a76-b95f-8d0c96bcb369","Type":"ContainerDied","Data":"e4d1a1425c530f57f3ad795273c4b8a8be03c2ebcacea503411fc81882caaccc"}
Sep 10 04:36:21.193975 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.193947    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:21.307982 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.307870    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbf5c\" (UniqueName: \"kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c\") pod \"049bc331-80aa-4a76-b95f-8d0c96bcb369\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") "
Sep 10 04:36:21.307982 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.307980    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file\") pod \"049bc331-80aa-4a76-b95f-8d0c96bcb369\" (UID: \"049bc331-80aa-4a76-b95f-8d0c96bcb369\") "
Sep 10 04:36:21.308376 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.308300    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file" (OuterVolumeSpecName: "config-file") pod "049bc331-80aa-4a76-b95f-8d0c96bcb369" (UID: "049bc331-80aa-4a76-b95f-8d0c96bcb369"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 04:36:21.309966 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.309937    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c" (OuterVolumeSpecName: "kube-api-access-zbf5c") pod "049bc331-80aa-4a76-b95f-8d0c96bcb369" (UID: "049bc331-80aa-4a76-b95f-8d0c96bcb369"). InnerVolumeSpecName "kube-api-access-zbf5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:36:21.409199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.409159    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbf5c\" (UniqueName: \"kubernetes.io/projected/049bc331-80aa-4a76-b95f-8d0c96bcb369-kube-api-access-zbf5c\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:21.409199 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.409196    2526 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/049bc331-80aa-4a76-b95f-8d0c96bcb369-config-file\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:21.664581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.664501    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s"
Sep 10 04:36:21.664581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.664511    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-gqf4s" event={"ID":"049bc331-80aa-4a76-b95f-8d0c96bcb369","Type":"ContainerDied","Data":"bed323ced87f25aa006f53c8f861e73d96a6e27a7510fa6350ac308d483cebad"}
Sep 10 04:36:21.664581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.664572    2526 scope.go:117] "RemoveContainer" containerID="e4d1a1425c530f57f3ad795273c4b8a8be03c2ebcacea503411fc81882caaccc"
Sep 10 04:36:21.684350 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.684324    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:21.689699 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:21.689674    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-gqf4s"]
Sep 10 04:36:22.271030 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.270989    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"]
Sep 10 04:36:22.271469 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271451    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7ce530b-ca70-4005-bca9-a225d1a22658" containerName="authorino"
Sep 10 04:36:22.271535 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271471    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7ce530b-ca70-4005-bca9-a225d1a22658" containerName="authorino"
Sep 10 04:36:22.271535 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271497    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049bc331-80aa-4a76-b95f-8d0c96bcb369" containerName="limitador"
Sep 10 04:36:22.271535 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271506    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="049bc331-80aa-4a76-b95f-8d0c96bcb369" containerName="limitador"
Sep 10 04:36:22.271623 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271579    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7ce530b-ca70-4005-bca9-a225d1a22658" containerName="authorino"
Sep 10 04:36:22.271623 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.271591    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="049bc331-80aa-4a76-b95f-8d0c96bcb369" containerName="limitador"
Sep 10 04:36:22.276112 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.276090    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.278417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.278392    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 04:36:22.278565 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.278394    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 04:36:22.278989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.278971    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 04:36:22.278989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.278980    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jvht7\""
Sep 10 04:36:22.281844 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.281824    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"]
Sep 10 04:36:22.303367 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.303341    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049bc331-80aa-4a76-b95f-8d0c96bcb369" path="/var/lib/kubelet/pods/049bc331-80aa-4a76-b95f-8d0c96bcb369/volumes"
Sep 10 04:36:22.317396 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.317367    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ded311-15d3-4b5f-bec3-665920926765-data\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.317691 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.317407    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr79m\" (UniqueName: \"kubernetes.io/projected/82ded311-15d3-4b5f-bec3-665920926765-kube-api-access-cr79m\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.418145 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.418113    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ded311-15d3-4b5f-bec3-665920926765-data\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.418303 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.418166    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr79m\" (UniqueName: \"kubernetes.io/projected/82ded311-15d3-4b5f-bec3-665920926765-kube-api-access-cr79m\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.418500 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.418482    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/82ded311-15d3-4b5f-bec3-665920926765-data\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.426954 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.426889    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr79m\" (UniqueName: \"kubernetes.io/projected/82ded311-15d3-4b5f-bec3-665920926765-kube-api-access-cr79m\") pod \"postgres-69fb4594cf-vppnt\" (UID: \"82ded311-15d3-4b5f-bec3-665920926765\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.587303 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.587264    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:22.856697 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:22.856503    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"]
Sep 10 04:36:22.858971 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:22.858946    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ded311_15d3_4b5f_bec3_665920926765.slice/crio-a2b248a8b31a0d7e3a57c28322591c61f8988e1b18433badca4d82b5937f1354 WatchSource:0}: Error finding container a2b248a8b31a0d7e3a57c28322591c61f8988e1b18433badca4d82b5937f1354: Status 404 returned error can't find the container with id a2b248a8b31a0d7e3a57c28322591c61f8988e1b18433badca4d82b5937f1354
Sep 10 04:36:23.677093 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:23.677036    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt" event={"ID":"82ded311-15d3-4b5f-bec3-665920926765","Type":"ContainerStarted","Data":"a2b248a8b31a0d7e3a57c28322591c61f8988e1b18433badca4d82b5937f1354"}
Sep 10 04:36:25.688818 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:25.688768    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt" event={"ID":"82ded311-15d3-4b5f-bec3-665920926765","Type":"ContainerStarted","Data":"9f125f5e0b9e20c518fb8b051315e6a148da901861f875a9c21e6ac234aa9acc"}
Sep 10 04:36:25.689241 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:25.688981    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:25.704615 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:25.704556    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt" podStartSLOduration=1.747528263 podStartE2EDuration="3.704539283s" totalImagesPullingTime="1.95701102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:25.704491473 +0000 UTC m=+619.922518125" watchObservedRunningTime="2026-09-10 04:36:25.704539283 +0000 UTC m=+619.922565931"
Sep 10 04:36:31.722188 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:31.722104    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vppnt"
Sep 10 04:36:39.010049 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.010015    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:39.016477 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.016456    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.018639 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.018611    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 04:36:39.018757 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.018682    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 04:36:39.018757 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.018682    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-r25sb\""
Sep 10 04:36:39.019298 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.019283    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 04:36:39.026762 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.026737    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:39.167198 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.167154    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.167391 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.167278    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.167391 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.167319    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghz82\" (UniqueName: \"kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.202358 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.202326    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79b4ff944b-6hskm"]
Sep 10 04:36:39.205609 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.205589    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.214480 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.214451    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b4ff944b-6hskm"]
Sep 10 04:36:39.268085 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.267979    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.268085 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.268051    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.268287 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.268098    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghz82\" (UniqueName: \"kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.270471 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.270446    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.270588 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.270477    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.285234 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.285205    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghz82\" (UniqueName: \"kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82\") pod \"maas-controller-5d7f96846b-qs2vc\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") " pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.328328 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.328300    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:39.369413 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.369380    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brsct\" (UniqueName: \"kubernetes.io/projected/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-kube-api-access-brsct\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.369581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.369429    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-webhook-cert\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.369581 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.369462    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-metrics-certs\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.470893 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.470855    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brsct\" (UniqueName: \"kubernetes.io/projected/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-kube-api-access-brsct\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.471090 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.470905    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-webhook-cert\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.471090 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.470954    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-metrics-certs\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.473469 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.473446    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-webhook-cert\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.473590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.473481    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-metrics-certs\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.478111 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.478092    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brsct\" (UniqueName: \"kubernetes.io/projected/f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24-kube-api-access-brsct\") pod \"maas-controller-79b4ff944b-6hskm\" (UID: \"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24\") " pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.517087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.517049    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:39.601201 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.601170    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:39.603462 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:39.603438    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc57ff216_0e91_46e4_9ecb_d24f55a7046a.slice/crio-1bc234efdcdf46d630df927c9bc4e1c374febc9b7eac62b0b8fb4877e6bc9490 WatchSource:0}: Error finding container 1bc234efdcdf46d630df927c9bc4e1c374febc9b7eac62b0b8fb4877e6bc9490: Status 404 returned error can't find the container with id 1bc234efdcdf46d630df927c9bc4e1c374febc9b7eac62b0b8fb4877e6bc9490
Sep 10 04:36:39.748355 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.748322    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" event={"ID":"c57ff216-0e91-46e4-9ecb-d24f55a7046a","Type":"ContainerStarted","Data":"1bc234efdcdf46d630df927c9bc4e1c374febc9b7eac62b0b8fb4877e6bc9490"}
Sep 10 04:36:39.788458 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:39.788432    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79b4ff944b-6hskm"]
Sep 10 04:36:39.791404 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:36:39.791375    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87bdc6c_77b2_42b7_a1b1_77fe2a62fc24.slice/crio-8c76a5f5b512319307e4038e202be21012a547f101e6ef60ebace6280584f8c0 WatchSource:0}: Error finding container 8c76a5f5b512319307e4038e202be21012a547f101e6ef60ebace6280584f8c0: Status 404 returned error can't find the container with id 8c76a5f5b512319307e4038e202be21012a547f101e6ef60ebace6280584f8c0
Sep 10 04:36:40.757905 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:40.757837    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b4ff944b-6hskm" event={"ID":"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24","Type":"ContainerStarted","Data":"8c76a5f5b512319307e4038e202be21012a547f101e6ef60ebace6280584f8c0"}
Sep 10 04:36:42.771738 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.771695    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79b4ff944b-6hskm" event={"ID":"f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24","Type":"ContainerStarted","Data":"533a265b1d364a491174ddf285611f8b7cccc73b1917656db20e790519bb7f01"}
Sep 10 04:36:42.772198 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.771771    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:42.773119 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.773096    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" event={"ID":"c57ff216-0e91-46e4-9ecb-d24f55a7046a","Type":"ContainerStarted","Data":"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"}
Sep 10 04:36:42.773230 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.773215    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:42.844596 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.844539    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" podStartSLOduration=2.162913808 podStartE2EDuration="4.844521911s" totalImagesPullingTime="2.681608103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:42.843360489 +0000 UTC m=+637.061387139" watchObservedRunningTime="2026-09-10 04:36:42.844521911 +0000 UTC m=+637.062548560"
Sep 10 04:36:42.844771 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:42.844695    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79b4ff944b-6hskm" podStartSLOduration=1.357514622 podStartE2EDuration="3.844689641s" totalImagesPullingTime="2.487175019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:36:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:36:42.816734518 +0000 UTC m=+637.034761166" watchObservedRunningTime="2026-09-10 04:36:42.844689641 +0000 UTC m=+637.062716343"
Sep 10 04:36:53.779768 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:53.779736    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:53.780183 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:53.779898    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79b4ff944b-6hskm"
Sep 10 04:36:53.838078 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:53.838041    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:53.838269 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:53.838230    2526 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" podUID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" containerName="manager" containerID="cri-o://4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15" gracePeriod=30
Sep 10 04:36:54.084881 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.084859    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:54.106087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.106053    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghz82\" (UniqueName: \"kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82\") pod \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") "
Sep 10 04:36:54.106252 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.106135    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert\") pod \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") "
Sep 10 04:36:54.106252 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.106167    2526 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs\") pod \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\" (UID: \"c57ff216-0e91-46e4-9ecb-d24f55a7046a\") "
Sep 10 04:36:54.108522 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.108481    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c57ff216-0e91-46e4-9ecb-d24f55a7046a" (UID: "c57ff216-0e91-46e4-9ecb-d24f55a7046a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:36:54.108732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.108708    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c57ff216-0e91-46e4-9ecb-d24f55a7046a" (UID: "c57ff216-0e91-46e4-9ecb-d24f55a7046a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 04:36:54.108732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.108717    2526 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82" (OuterVolumeSpecName: "kube-api-access-ghz82") pod "c57ff216-0e91-46e4-9ecb-d24f55a7046a" (UID: "c57ff216-0e91-46e4-9ecb-d24f55a7046a"). InnerVolumeSpecName "kube-api-access-ghz82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 04:36:54.206664 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.206630    2526 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-webhook-cert\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:54.206664 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.206658    2526 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c57ff216-0e91-46e4-9ecb-d24f55a7046a-metrics-certs\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:54.206664 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.206668    2526 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghz82\" (UniqueName: \"kubernetes.io/projected/c57ff216-0e91-46e4-9ecb-d24f55a7046a-kube-api-access-ghz82\") on node \"ip-10-0-137-116.ec2.internal\" DevicePath \"\""
Sep 10 04:36:54.828109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.828060    2526 generic.go:356] "Generic (PLEG): container finished" podID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" containerID="4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15" exitCode=0
Sep 10 04:36:54.828577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.828119    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" event={"ID":"c57ff216-0e91-46e4-9ecb-d24f55a7046a","Type":"ContainerDied","Data":"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"}
Sep 10 04:36:54.828577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.828156    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d7f96846b-qs2vc" event={"ID":"c57ff216-0e91-46e4-9ecb-d24f55a7046a","Type":"ContainerDied","Data":"1bc234efdcdf46d630df927c9bc4e1c374febc9b7eac62b0b8fb4877e6bc9490"}
Sep 10 04:36:54.828577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.828176    2526 scope.go:117] "RemoveContainer" containerID="4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"
Sep 10 04:36:54.828577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.828119    2526 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d7f96846b-qs2vc"
Sep 10 04:36:54.838498 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.838477    2526 scope.go:117] "RemoveContainer" containerID="4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"
Sep 10 04:36:54.838767 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:36:54.838746    2526 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15\": container with ID starting with 4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15 not found: ID does not exist" containerID="4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"
Sep 10 04:36:54.838813 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.838777    2526 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15"} err="failed to get container status \"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15\": rpc error: code = NotFound desc = could not find container \"4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15\": container with ID starting with 4008bbde98930375dda3ec9fc4e392450b929901649e191443b34b26161a7d15 not found: ID does not exist"
Sep 10 04:36:54.843356 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.843335    2526 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:54.848628 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:54.848599    2526 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d7f96846b-qs2vc"]
Sep 10 04:36:56.303112 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:36:56.303074    2526 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" path="/var/lib/kubelet/pods/c57ff216-0e91-46e4-9ecb-d24f55a7046a/volumes"
Sep 10 04:37:16.621598 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.621561    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"]
Sep 10 04:37:16.622085 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.621960    2526 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" containerName="manager"
Sep 10 04:37:16.622085 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.621976    2526 state_mem.go:107] "Deleted CPUSet assignment" podUID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" containerName="manager"
Sep 10 04:37:16.622085 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.622032    2526 memory_manager.go:368] "RemoveStaleState removing state" podUID="c57ff216-0e91-46e4-9ecb-d24f55a7046a" containerName="manager"
Sep 10 04:37:16.628405 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.628383    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.630529 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.630508    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 04:37:16.630529 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.630523    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hx72t\""
Sep 10 04:37:16.630746 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.630728    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 04:37:16.638662 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.638639    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"]
Sep 10 04:37:16.707325 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.707293    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-maas-api-tls\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.707532 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.707341    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gkvh\" (UniqueName: \"kubernetes.io/projected/16c34f6f-18b4-4b03-86fd-61efc9153746-kube-api-access-2gkvh\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.707532 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.707438    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-metrics-certs\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.707532 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.707491    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16c34f6f-18b4-4b03-86fd-61efc9153746-openshift-service-ca\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.808920 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.808886    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-maas-api-tls\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.809109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.808966    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gkvh\" (UniqueName: \"kubernetes.io/projected/16c34f6f-18b4-4b03-86fd-61efc9153746-kube-api-access-2gkvh\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.809109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.809000    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-metrics-certs\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.809109 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.809023    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16c34f6f-18b4-4b03-86fd-61efc9153746-openshift-service-ca\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.809653 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.809628    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16c34f6f-18b4-4b03-86fd-61efc9153746-openshift-service-ca\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.811370 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.811348    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-maas-api-tls\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.811491 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.811434    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16c34f6f-18b4-4b03-86fd-61efc9153746-metrics-certs\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.817826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.817800    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gkvh\" (UniqueName: \"kubernetes.io/projected/16c34f6f-18b4-4b03-86fd-61efc9153746-kube-api-access-2gkvh\") pod \"maas-api-9d8fcf686-679zs\" (UID: \"16c34f6f-18b4-4b03-86fd-61efc9153746\") " pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:16.938623 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:16.938537    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:17.222150 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.222126    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"]
Sep 10 04:37:17.225075 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:37:17.225049    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c34f6f_18b4_4b03_86fd_61efc9153746.slice/crio-bbdfec925c44be2a11daba1c0b502776b557fbd71aae83a29b86e731f6c8f673 WatchSource:0}: Error finding container bbdfec925c44be2a11daba1c0b502776b557fbd71aae83a29b86e731f6c8f673: Status 404 returned error can't find the container with id bbdfec925c44be2a11daba1c0b502776b557fbd71aae83a29b86e731f6c8f673
Sep 10 04:37:17.245472 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.245447    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"]
Sep 10 04:37:17.249961 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.249942    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.252567 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.252547    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 04:37:17.260312 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.260289    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"]
Sep 10 04:37:17.313687 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.313655    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42rrp\" (UniqueName: \"kubernetes.io/projected/f23e9f4d-890d-4a30-a8b3-631d3e586293-kube-api-access-42rrp\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.313687 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.313693    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f23e9f4d-890d-4a30-a8b3-631d3e586293-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.414973 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.414919    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42rrp\" (UniqueName: \"kubernetes.io/projected/f23e9f4d-890d-4a30-a8b3-631d3e586293-kube-api-access-42rrp\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.415169 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.415076    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f23e9f4d-890d-4a30-a8b3-631d3e586293-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.415707 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.415688    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f23e9f4d-890d-4a30-a8b3-631d3e586293-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.422885 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.422862    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42rrp\" (UniqueName: \"kubernetes.io/projected/f23e9f4d-890d-4a30-a8b3-631d3e586293-kube-api-access-42rrp\") pod \"payload-pre-processing-59fbc47bf8-hqfp4\" (UID: \"f23e9f4d-890d-4a30-a8b3-631d3e586293\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.561515 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.561485    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:17.834891 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.834861    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"]
Sep 10 04:37:17.838077 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:37:17.838047    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23e9f4d_890d_4a30_a8b3_631d3e586293.slice/crio-0c64e09c678bbe4ab4862554761945373c99ba051e79c4901324fa13da5de342 WatchSource:0}: Error finding container 0c64e09c678bbe4ab4862554761945373c99ba051e79c4901324fa13da5de342: Status 404 returned error can't find the container with id 0c64e09c678bbe4ab4862554761945373c99ba051e79c4901324fa13da5de342
Sep 10 04:37:17.937414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.937375    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs" event={"ID":"16c34f6f-18b4-4b03-86fd-61efc9153746","Type":"ContainerStarted","Data":"bbdfec925c44be2a11daba1c0b502776b557fbd71aae83a29b86e731f6c8f673"}
Sep 10 04:37:17.938848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:17.938816    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4" event={"ID":"f23e9f4d-890d-4a30-a8b3-631d3e586293","Type":"ContainerStarted","Data":"0c64e09c678bbe4ab4862554761945373c99ba051e79c4901324fa13da5de342"}
Sep 10 04:37:19.950642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:19.950599    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs" event={"ID":"16c34f6f-18b4-4b03-86fd-61efc9153746","Type":"ContainerStarted","Data":"745cbaa812e74188aee1fc92c0508cb23e5a03e1ff24838f004b13ce4d83481a"}
Sep 10 04:37:19.951121 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:19.950682    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:20.956403 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:20.956364    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4" event={"ID":"f23e9f4d-890d-4a30-a8b3-631d3e586293","Type":"ContainerStarted","Data":"bf56d4d91d3bd062036f89db78e301168be203bb973ca23a0fdabde620958477"}
Sep 10 04:37:20.956876 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:20.956605    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:20.971898 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:20.971834    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs" podStartSLOduration=3.300267768 podStartE2EDuration="4.97181262s" totalImagesPullingTime="1.671544852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:37:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:37:19.988172541 +0000 UTC m=+674.206199190" watchObservedRunningTime="2026-09-10 04:37:20.97181262 +0000 UTC m=+675.189839273"
Sep 10 04:37:25.962205 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:25.962175    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-9d8fcf686-679zs"
Sep 10 04:37:25.980002 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:25.979949    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4" podStartSLOduration=6.499519868 podStartE2EDuration="8.979916267s" totalImagesPullingTime="2.480396399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:37:20.973661549 +0000 UTC m=+675.191688199" watchObservedRunningTime="2026-09-10 04:37:25.979916267 +0000 UTC m=+680.197942950"
Sep 10 04:37:26.987435 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.987334    2526 generic.go:356] "Generic (PLEG): container finished" podID="b5224073-c872-4142-9df3-5b4ad6448635" containerID="0db14fa1a5594949de9fc1a29732d9125fb43f08094d4c0fa6cbd4991b6bdf19" exitCode=0
Sep 10 04:37:26.987920 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.987416    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" event={"ID":"b5224073-c872-4142-9df3-5b4ad6448635","Type":"ContainerDied","Data":"0db14fa1a5594949de9fc1a29732d9125fb43f08094d4c0fa6cbd4991b6bdf19"}
Sep 10 04:37:26.987920 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.987915    2526 scope.go:117] "RemoveContainer" containerID="0db14fa1a5594949de9fc1a29732d9125fb43f08094d4c0fa6cbd4991b6bdf19"
Sep 10 04:37:26.989003 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.988976    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:37:26.989103 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.989055    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:37:26.989168 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:26.989129    2526 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 10 04:37:27.996453 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:27.996416    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" event={"ID":"b5224073-c872-4142-9df3-5b4ad6448635","Type":"ContainerStarted","Data":"7631fea616bfd0b7521876b170f4f17b10ee04027f89a37e7c00a29ecb9f7a77"}
Sep 10 04:37:28.138724 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:28.138689    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:37:28.138918 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:28.138899    2526 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkzk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 04:37:28.138996 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:28.138967    2526 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podUID="b5224073-c872-4142-9df3-5b4ad6448635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 04:37:29.138676 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:29.138640    2526 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkzk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 04:37:29.139135 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:29.138693    2526 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podUID="b5224073-c872-4142-9df3-5b4ad6448635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 04:37:30.138826 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:30.138791    2526 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkzk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 04:37:30.139234 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:30.138843    2526 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podUID="b5224073-c872-4142-9df3-5b4ad6448635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 04:37:31.139302 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:31.139259    2526 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkzk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 04:37:31.139712 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:31.139328    2526 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podUID="b5224073-c872-4142-9df3-5b4ad6448635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 04:37:31.964110 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:31.964080    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hqfp4"
Sep 10 04:37:32.138843 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:32.138808    2526 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vkzk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 04:37:32.139035 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:32.138866    2526 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9" podUID="b5224073-c872-4142-9df3-5b4ad6448635" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 04:37:33.142772 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:33.142739    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:37:33.143171 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:33.143099    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:37:33.143832 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:37:33.143813    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vkzk9"
Sep 10 04:38:15.818624 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.818588    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"]
Sep 10 04:38:15.822293 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.822266    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.825848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.825814    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 04:38:15.825848 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.825834    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 10 04:38:15.826113 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.825870    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cl8w9\""
Sep 10 04:38:15.826113 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.825905    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 04:38:15.836347 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.836318    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"]
Sep 10 04:38:15.916427 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916389    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.916601 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916436    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bjsw\" (UniqueName: \"kubernetes.io/projected/fa6aff69-3d4f-486c-95db-f37054882b30-kube-api-access-9bjsw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.916601 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916488    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.916601 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916522    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.916601 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916578    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:15.916736 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:15.916603    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa6aff69-3d4f-486c-95db-f37054882b30-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017438 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017394    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017438 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017444    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bjsw\" (UniqueName: \"kubernetes.io/projected/fa6aff69-3d4f-486c-95db-f37054882b30-kube-api-access-9bjsw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017468    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017485    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017511    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017682 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017527    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa6aff69-3d4f-486c-95db-f37054882b30-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.017971 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017917    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.018062 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.017974    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.018062 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.018038    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.019694 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.019672    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa6aff69-3d4f-486c-95db-f37054882b30-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.020000 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.019984    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa6aff69-3d4f-486c-95db-f37054882b30-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.033836 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.033806    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bjsw\" (UniqueName: \"kubernetes.io/projected/fa6aff69-3d4f-486c-95db-f37054882b30-kube-api-access-9bjsw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62\" (UID: \"fa6aff69-3d4f-486c-95db-f37054882b30\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.141600 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.141509    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:16.418839 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.418791    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"]
Sep 10 04:38:16.421336 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:38:16.421308    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6aff69_3d4f_486c_95db_f37054882b30.slice/crio-4f543fc7aaa27b2e08e5163a7726fb55f4add9eadba376fd5e2f0ef9236ed5f0 WatchSource:0}: Error finding container 4f543fc7aaa27b2e08e5163a7726fb55f4add9eadba376fd5e2f0ef9236ed5f0: Status 404 returned error can't find the container with id 4f543fc7aaa27b2e08e5163a7726fb55f4add9eadba376fd5e2f0ef9236ed5f0
Sep 10 04:38:16.422823 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:16.422803    2526 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 04:38:17.225795 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:17.225759    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62" event={"ID":"fa6aff69-3d4f-486c-95db-f37054882b30","Type":"ContainerStarted","Data":"4f543fc7aaa27b2e08e5163a7726fb55f4add9eadba376fd5e2f0ef9236ed5f0"}
Sep 10 04:38:18.232036 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:18.231999    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62" event={"ID":"fa6aff69-3d4f-486c-95db-f37054882b30","Type":"ContainerStarted","Data":"ffd19cb45b5029347aa5457e1ca3d44b171623c9590306117ca437177ca30d14"}
Sep 10 04:38:18.250361 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:18.250305    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62" podStartSLOduration=2.280930135 podStartE2EDuration="3.25028832s" totalImagesPullingTime="969.358185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 04:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:38:18.249279742 +0000 UTC m=+732.467306393" watchObservedRunningTime="2026-09-10 04:38:18.25028832 +0000 UTC m=+732.468314970"
Sep 10 04:38:26.142165 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:26.142128    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:26.142533 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:26.142198    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:26.155462 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:26.155437    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:26.279005 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:26.278977    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62"
Sep 10 04:38:39.120993 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.120959    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"]
Sep 10 04:38:39.125948 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.125912    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.128264 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.128235    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 10 04:38:39.134306 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.134279    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"]
Sep 10 04:38:39.210076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210036    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.210246 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210090    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7636e8b8-4363-4e89-b98d-cb8b15277a97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.210246 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210124    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh25z\" (UniqueName: \"kubernetes.io/projected/7636e8b8-4363-4e89-b98d-cb8b15277a97-kube-api-access-jh25z\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.210246 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210150    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.210246 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210174    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.210246 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.210197    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.310834 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.310797    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7636e8b8-4363-4e89-b98d-cb8b15277a97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.310834 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.310835    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh25z\" (UniqueName: \"kubernetes.io/projected/7636e8b8-4363-4e89-b98d-cb8b15277a97-kube-api-access-jh25z\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311124 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.310856    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311124 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.310880    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311124 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.310911    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311124 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.311011    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.311301    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.311330    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.311424 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.311406    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.313204 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.313173    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7636e8b8-4363-4e89-b98d-cb8b15277a97-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.313348 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.313332    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7636e8b8-4363-4e89-b98d-cb8b15277a97-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.318539 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.318520    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh25z\" (UniqueName: \"kubernetes.io/projected/7636e8b8-4363-4e89-b98d-cb8b15277a97-kube-api-access-jh25z\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn\" (UID: \"7636e8b8-4363-4e89-b98d-cb8b15277a97\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.439368 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.439275    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:39.712707 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:39.712683    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"]
Sep 10 04:38:39.714769 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:38:39.714737    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7636e8b8_4363_4e89_b98d_cb8b15277a97.slice/crio-4585f4bd4936cadb71828396d7dc0333573f0c5a55cf0fb4d3382fda6b6341f7 WatchSource:0}: Error finding container 4585f4bd4936cadb71828396d7dc0333573f0c5a55cf0fb4d3382fda6b6341f7: Status 404 returned error can't find the container with id 4585f4bd4936cadb71828396d7dc0333573f0c5a55cf0fb4d3382fda6b6341f7
Sep 10 04:38:40.335476 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:40.335446    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="2dc4ad27ff2618dc39bfdc75f66ac62b5ddc907d694efb288f72c60d5df35ed0" exitCode=0
Sep 10 04:38:40.335858 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:40.335514    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"2dc4ad27ff2618dc39bfdc75f66ac62b5ddc907d694efb288f72c60d5df35ed0"}
Sep 10 04:38:40.335858 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:40.335556    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerStarted","Data":"4585f4bd4936cadb71828396d7dc0333573f0c5a55cf0fb4d3382fda6b6341f7"}
Sep 10 04:38:40.335858 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:40.335773    2526 scope.go:117] "RemoveContainer" containerID="2dc4ad27ff2618dc39bfdc75f66ac62b5ddc907d694efb288f72c60d5df35ed0"
Sep 10 04:38:41.342489 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:41.342456    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17" exitCode=0
Sep 10 04:38:41.342880 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:41.342554    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"}
Sep 10 04:38:41.342880 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:41.342611    2526 scope.go:117] "RemoveContainer" containerID="2dc4ad27ff2618dc39bfdc75f66ac62b5ddc907d694efb288f72c60d5df35ed0"
Sep 10 04:38:41.342880 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:41.342745    2526 scope.go:117] "RemoveContainer" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"
Sep 10 04:38:41.343002 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:41.342947    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:38:42.348326 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:42.348295    2526 scope.go:117] "RemoveContainer" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"
Sep 10 04:38:42.348710 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:42.348469    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:38:44.824176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.824140    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"]
Sep 10 04:38:44.828808 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.828773    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.831225 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.831201    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 10 04:38:44.839449 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.839423    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"]
Sep 10 04:38:44.958490 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958450    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.958490 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958490    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.958723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958518    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.958723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958541    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v8n4\" (UniqueName: \"kubernetes.io/projected/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-kube-api-access-7v8n4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.958723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958581    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:44.958723 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:44.958650    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.059854 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059807    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.059854 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059853    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060147 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059877    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060147 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059900    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v8n4\" (UniqueName: \"kubernetes.io/projected/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-kube-api-access-7v8n4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060147 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059966    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060147 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.059996    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060373 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.060280    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060373 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.060359    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.060465 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.060421    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.062154 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.062120    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.062393 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.062377    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.068077 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.068052    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v8n4\" (UniqueName: \"kubernetes.io/projected/dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6-kube-api-access-7v8n4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r\" (UID: \"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.138969 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.138848    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:45.412775 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:45.412745    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"]
Sep 10 04:38:45.415177 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:38:45.415147    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2f1bce_3b05_4aa1_b711_49d9a46bdfc6.slice/crio-795844ca44105d7fb96f0d737035c18179a648761bfae51f9e90e314190dee03 WatchSource:0}: Error finding container 795844ca44105d7fb96f0d737035c18179a648761bfae51f9e90e314190dee03: Status 404 returned error can't find the container with id 795844ca44105d7fb96f0d737035c18179a648761bfae51f9e90e314190dee03
Sep 10 04:38:46.368122 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:46.368085    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="9f6ee026594e4adbd4c6a2196cfe5a7224fa61fe6e660844dff2de05cf1a0d69" exitCode=0
Sep 10 04:38:46.368567 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:46.368168    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"9f6ee026594e4adbd4c6a2196cfe5a7224fa61fe6e660844dff2de05cf1a0d69"}
Sep 10 04:38:46.368567 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:46.368219    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerStarted","Data":"795844ca44105d7fb96f0d737035c18179a648761bfae51f9e90e314190dee03"}
Sep 10 04:38:46.368567 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:46.368438    2526 scope.go:117] "RemoveContainer" containerID="9f6ee026594e4adbd4c6a2196cfe5a7224fa61fe6e660844dff2de05cf1a0d69"
Sep 10 04:38:47.376159 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:47.376118    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726" exitCode=0
Sep 10 04:38:47.376703 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:47.376191    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"}
Sep 10 04:38:47.376703 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:47.376247    2526 scope.go:117] "RemoveContainer" containerID="9f6ee026594e4adbd4c6a2196cfe5a7224fa61fe6e660844dff2de05cf1a0d69"
Sep 10 04:38:47.376703 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:47.376526    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:38:47.376812 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:47.376722    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:38:48.383079 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:48.383051    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:38:48.383569 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:48.383313    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:38:49.439843 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:49.439812    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:49.440231 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:49.439868    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:49.440231 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:49.439885    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:49.440231 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:49.439897    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:38:49.440330 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:49.440267    2526 scope.go:117] "RemoveContainer" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"
Sep 10 04:38:49.440453 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:49.440433    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:38:55.139250 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.139200    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:55.139250 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.139257    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:55.139692 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.139501    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:55.139692 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.139540    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:38:55.139692 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.139655    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:38:55.139823 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:55.139803    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:38:55.416425 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:38:55.416347    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:38:55.416569 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:38:55.416501    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:04.297882 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:04.297849    2526 scope.go:117] "RemoveContainer" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"
Sep 10 04:39:05.466622 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:05.466583    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237" exitCode=0
Sep 10 04:39:05.467087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:05.466652    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"}
Sep 10 04:39:05.467087 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:05.466710    2526 scope.go:117] "RemoveContainer" containerID="91c70aa11628fb9cd037819ab6268a4561f6e4699672a1e1ea41b73e7fbbad17"
Sep 10 04:39:05.467230 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:05.467138    2526 scope.go:117] "RemoveContainer" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"
Sep 10 04:39:05.467380 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:05.467360    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:39:07.298092 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:07.298059    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:39:08.487739 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:08.487689    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2" exitCode=0
Sep 10 04:39:08.488204 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:08.487761    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2"}
Sep 10 04:39:08.488204 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:08.487809    2526 scope.go:117] "RemoveContainer" containerID="6c2f9dcdbb615d9e4719c32b0d00df04317d2ed0239dc6f2742d8e9e87006726"
Sep 10 04:39:08.488204 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:08.488170    2526 scope.go:117] "RemoveContainer" containerID="732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2"
Sep 10 04:39:08.488349 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:08.488327    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:09.440377 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:09.440324    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:09.440585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:09.440446    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:09.440585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:09.440473    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:09.440585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:09.440490    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:09.440883 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:09.440865    2526 scope.go:117] "RemoveContainer" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"
Sep 10 04:39:09.441074 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:09.441055    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:39:15.139171 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:15.139139    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:15.139577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:15.139186    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:15.139577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:15.139197    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:15.139577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:15.139206    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:15.139577 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:15.139504    2526 scope.go:117] "RemoveContainer" containerID="732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2"
Sep 10 04:39:15.139706 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:15.139653    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:20.298146 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:20.298112    2526 scope.go:117] "RemoveContainer" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"
Sep 10 04:39:20.298620 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:20.298295    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:39:30.298634 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:30.298560    2526 scope.go:117] "RemoveContainer" containerID="732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2"
Sep 10 04:39:30.594291 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:30.594262    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a" exitCode=0
Sep 10 04:39:30.594432 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:30.594321    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"}
Sep 10 04:39:30.594432 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:30.594361    2526 scope.go:117] "RemoveContainer" containerID="732655e70e9082874d7db841460b1ea745cb78e35c345bb559bd9851b8a586c2"
Sep 10 04:39:30.594696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:30.594673    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:39:30.594878 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:30.594860    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:33.297779 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:33.297749    2526 scope.go:117] "RemoveContainer" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"
Sep 10 04:39:33.612459 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:33.612384    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92" exitCode=0
Sep 10 04:39:33.612459 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:33.612422    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"}
Sep 10 04:39:33.612661 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:33.612468    2526 scope.go:117] "RemoveContainer" containerID="0394781d96bc74f914048b32d75ec03f0228ff10827a44cc2996a77c699cd237"
Sep 10 04:39:33.612836 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:33.612815    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:39:33.613052 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:33.613032    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:39:35.139807 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:35.139762    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:35.139807 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:35.139817    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:35.140253 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:35.139829    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:35.140253 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:35.139837    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:39:35.140253 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:35.140178    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:39:35.140348 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:35.140322    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:39.439647 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:39.439600    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:39.440076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:39.439678    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:39.440076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:39.439695    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:39.440076 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:39.439709    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:39:39.440176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:39.440093    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:39:39.440285 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:39.440266    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:39:49.298331 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:49.298296    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:39:49.298722 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:49.298481    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:39:51.298696 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:39:51.298660    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:39:51.299136 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:39:51.298830    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:40:03.298178 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:03.298143    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:40:03.298672 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:03.298303    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:40:06.300320 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:06.300278    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:40:06.300782 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:06.300470    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:40:18.298582 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:18.298536    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:40:18.835271 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:18.835174    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2" exitCode=0
Sep 10 04:40:18.835271 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:18.835217    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"}
Sep 10 04:40:18.835271 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:18.835263    2526 scope.go:117] "RemoveContainer" containerID="8499e765b3caf97b8c548f8c278dcb0a04a4c1aae9c3faa03f7062b74c39540a"
Sep 10 04:40:18.835601 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:18.835563    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:40:18.835774 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:18.835753    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:40:21.297585 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:21.297550    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:40:21.854466 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:21.854373    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e" exitCode=0
Sep 10 04:40:21.854466 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:21.854439    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"}
Sep 10 04:40:21.854702 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:21.854519    2526 scope.go:117] "RemoveContainer" containerID="9eaa94cd55d277f0608bcede7c50c15905995e39141c03636d826f454e087d92"
Sep 10 04:40:21.854902 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:21.854881    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:40:21.855111 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:21.855080    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:40:25.139079 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:25.139041    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:40:25.139504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:25.139093    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:40:25.139504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:25.139104    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:40:25.139504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:25.139115    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:40:25.139504 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:25.139441    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:40:25.139639 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:25.139586    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:40:29.439701 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:29.439661    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:40:29.440206 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:29.439724    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:40:29.440206 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:29.439740    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:40:29.440206 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:29.439753    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:40:29.440206 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:29.440138    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:40:29.440394 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:29.440313    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:40:37.297689 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:37.297652    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:40:37.298173 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:37.297813    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:40:43.298648 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:43.298613    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:40:43.299035 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:43.298818    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:40:52.298065 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:52.298025    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:40:52.298585 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:52.298238    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:40:56.300627 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:40:56.300597    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:40:56.301037 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:40:56.300772    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:07.297642 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:07.297592    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:41:07.298055 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:07.297774    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:41:09.297832 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:09.297796    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:41:09.298319 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:09.298053    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:19.298284 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:19.298251    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:41:19.298694 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:19.298402    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:41:22.298144 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:22.298109    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:41:22.298669 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:22.298279    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:31.298183 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:31.298148    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:41:31.298561 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:31.298326    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:41:33.298368 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:33.298328    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:41:33.298855 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:33.298584    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:45.298010 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:45.297972    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:41:45.298449 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:45.298018    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:41:46.269095 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.269063    2526 generic.go:356] "Generic (PLEG): container finished" podID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c" exitCode=0
Sep 10 04:41:46.269271 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.269141    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" event={"ID":"dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6","Type":"ContainerDied","Data":"ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"}
Sep 10 04:41:46.269271 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.269201    2526 scope.go:117] "RemoveContainer" containerID="f2ef6d7e8e1204cd6ea26d263aefe4e262a10eabb502e0e8060a7fef28ee62f2"
Sep 10 04:41:46.269565 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.269547    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:41:46.269787 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:46.269765    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:41:46.271400 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.271380    2526 generic.go:356] "Generic (PLEG): container finished" podID="7636e8b8-4363-4e89-b98d-cb8b15277a97" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9" exitCode=0
Sep 10 04:41:46.271501 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.271415    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" event={"ID":"7636e8b8-4363-4e89-b98d-cb8b15277a97","Type":"ContainerDied","Data":"c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"}
Sep 10 04:41:46.271734 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.271720    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:41:46.271900 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:46.271882    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:46.280395 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:46.280378    2526 scope.go:117] "RemoveContainer" containerID="ff945469b5b15288e0ea2190470befaabd1dad9ee80ec316bef3fc652e9d7f5e"
Sep 10 04:41:49.439656 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:49.439620    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:41:49.440095 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:49.439684    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:41:49.440095 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:49.439708    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:41:49.440095 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:49.439728    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn"
Sep 10 04:41:49.440200 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:49.440144    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:41:49.440361 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:49.440340    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:41:55.139815 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:55.139777    2526 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:41:55.139815 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:55.139825    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:41:55.140292 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:55.139836    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:41:55.140292 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:55.139845    2526 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r"
Sep 10 04:41:55.140292 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:41:55.140211    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:41:55.140386 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:41:55.140356    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:42:04.298565 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:04.298528    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:42:04.298973 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:04.298738    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:42:10.298463 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:10.298432    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:42:10.298850 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:10.298598    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:42:18.304032 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:18.304003    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:42:18.304526 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:18.304230    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:42:23.297807 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:23.297772    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:42:23.298239 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:23.298005    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:42:30.220608 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:30.220534    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_7636e8b8-4363-4e89-b98d-cb8b15277a97/main/5.log"
Sep 10 04:42:30.330414 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:30.330382    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_7636e8b8-4363-4e89-b98d-cb8b15277a97/main/5.log"
Sep 10 04:42:33.298352 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:33.298318    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:42:33.298736 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:33.298504    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:42:35.298045 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:35.298013    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:42:35.298452 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:35.298182    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:42:36.634991 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:36.634955    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7v75n_12bf9b71-2407-4184-af9b-a2c45210d105/manager/0.log"
Sep 10 04:42:36.755701 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:36.755671    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2m8xh_6b5bad58-114a-46fc-92c1-2d58681669ac/manager/0.log"
Sep 10 04:42:36.885113 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:36.885037    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79b4ff944b-6hskm_f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24/manager/0.log"
Sep 10 04:42:37.005355 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.005327    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6d6qc_9b84c280-d9ef-4d15-9185-7bd50418b278/server/0.log"
Sep 10 04:42:37.126739 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.126710    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l9h5x_31889ee2-17ab-4050-b0ac-8c14566e0dd6/manager/0.log"
Sep 10 04:42:37.506191 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.506165    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-z9q8j_b2750d83-8243-4524-817f-0b6b9696ebf6/copy-manifests/0.log"
Sep 10 04:42:37.517697 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.517671    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-z9q8j_b2750d83-8243-4524-817f-0b6b9696ebf6/manager/0.log"
Sep 10 04:42:37.874969 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.874913    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-9d8fcf686-679zs_16c34f6f-18b4-4b03-86fd-61efc9153746/maas-api/0.log"
Sep 10 04:42:37.988599 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:37.988555    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-vppnt_82ded311-15d3-4b5f-bec3-665920926765/postgres/0.log"
Sep 10 04:42:38.873998 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:38.873960    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hhgxc_22ca113f-724c-4121-afe4-c1429d7bd8c8/manager/0.log"
Sep 10 04:42:38.999241 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:38.999208    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rlxk7_c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3/manager/0.log"
Sep 10 04:42:39.110655 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:39.110628    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-nlrl5_1c92b2e3-5c21-43c4-8d78-4678a32468ba/kuadrant-console-plugin/0.log"
Sep 10 04:42:39.229447 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:39.229343    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lgcnp_cb9bd998-acf7-4a8e-b594-c778f5030f9b/manager/0.log"
Sep 10 04:42:39.815259 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:39.815232    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8_b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e/istio-proxy/0.log"
Sep 10 04:42:40.048769 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:40.048741    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-dfqx6_245fec92-534d-47e1-9098-521cc3b7bca1/kube-auth-proxy/0.log"
Sep 10 04:42:40.279685 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:40.279614    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/1.log"
Sep 10 04:42:40.396844 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:40.396814    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hqfp4_f23e9f4d-890d-4a30-a8b3-631d3e586293/payload-pre-processing/0.log"
Sep 10 04:42:41.184060 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:41.184032    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-rwq62_fa6aff69-3d4f-486c-95db-f37054882b30/main/0.log"
Sep 10 04:42:41.514200 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:41.514108    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_7636e8b8-4363-4e89-b98d-cb8b15277a97/main/5.log"
Sep 10 04:42:41.625084 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:41.625057    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6/main/5.log"
Sep 10 04:42:48.297578 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:48.297548    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:42:48.298113 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:48.297762    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:42:49.297859 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:49.297817    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:42:49.298363 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:42:49.298035    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:42:49.866071 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:49.866041    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x6fvh_68819b9e-ee1e-47c2-b8a5-ce1857439665/global-pull-secret-syncer/0.log"
Sep 10 04:42:49.928259 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:49.928226    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cj9gf_a5748ab3-c029-4f6a-a6ce-95d33d0ebc78/konnectivity-agent/0.log"
Sep 10 04:42:49.991364 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:49.991335    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-116.ec2.internal_ccd2cc3e7932d8aeb13e227945612366/haproxy/0.log"
Sep 10 04:42:54.586849 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:54.586819    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hhgxc_22ca113f-724c-4121-afe4-c1429d7bd8c8/manager/0.log"
Sep 10 04:42:54.614158 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:54.614128    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rlxk7_c4a3ca9b-3a14-4a18-92e7-c98c8dcef8b3/manager/0.log"
Sep 10 04:42:54.643979 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:54.643950    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-nlrl5_1c92b2e3-5c21-43c4-8d78-4678a32468ba/kuadrant-console-plugin/0.log"
Sep 10 04:42:54.680187 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:54.680149    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-lgcnp_cb9bd998-acf7-4a8e-b594-c778f5030f9b/manager/0.log"
Sep 10 04:42:56.737767 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:56.737742    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kklzs_bdbd284e-f246-4637-9b5a-89b20b19c17a/node-exporter/0.log"
Sep 10 04:42:56.755179 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:56.755154    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kklzs_bdbd284e-f246-4637-9b5a-89b20b19c17a/kube-rbac-proxy/0.log"
Sep 10 04:42:56.774345 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:56.774318    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kklzs_bdbd284e-f246-4637-9b5a-89b20b19c17a/init-textfile/0.log"
Sep 10 04:42:59.654056 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.654020    2526 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"]
Sep 10 04:42:59.657586 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.657569    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.659693 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.659669    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"openshift-service-ca.crt\""
Sep 10 04:42:59.660331 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.660304    2526 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zfjbl\"/\"default-dockercfg-gnz5s\""
Sep 10 04:42:59.660331 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.660325    2526 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zfjbl\"/\"kube-root-ca.crt\""
Sep 10 04:42:59.668123 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.668101    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"]
Sep 10 04:42:59.793163 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.793112    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-sys\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.793163 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.793176    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-lib-modules\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.793417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.793272    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qbmg\" (UniqueName: \"kubernetes.io/projected/092340b8-d21c-4b82-83d6-34f8b3d5491b-kube-api-access-5qbmg\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.793417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.793312    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-podres\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.793417 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.793357    2526 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-proc\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894552 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894494    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-lib-modules\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894596    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qbmg\" (UniqueName: \"kubernetes.io/projected/092340b8-d21c-4b82-83d6-34f8b3d5491b-kube-api-access-5qbmg\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894637    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-podres\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894658    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-lib-modules\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894668    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-proc\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894722    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-proc\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894899 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894757    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-podres\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894899 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894797    2526 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-sys\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.894899 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.894839    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/092340b8-d21c-4b82-83d6-34f8b3d5491b-sys\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.901622 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.901590    2526 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qbmg\" (UniqueName: \"kubernetes.io/projected/092340b8-d21c-4b82-83d6-34f8b3d5491b-kube-api-access-5qbmg\") pod \"perf-node-gather-daemonset-wznjq\" (UID: \"092340b8-d21c-4b82-83d6-34f8b3d5491b\") " pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:42:59.968824 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:42:59.968705    2526 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:43:00.238686 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:00.238657    2526 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"]
Sep 10 04:43:00.241293 ip-10-0-137-116 kubenswrapper[2526]: W0910 04:43:00.241267    2526 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod092340b8_d21c_4b82_83d6_34f8b3d5491b.slice/crio-89d3ecc7776cf41c2426fa49f0d2ee06c0921c8a7a31ba374e69aa64f4c8b376 WatchSource:0}: Error finding container 89d3ecc7776cf41c2426fa49f0d2ee06c0921c8a7a31ba374e69aa64f4c8b376: Status 404 returned error can't find the container with id 89d3ecc7776cf41c2426fa49f0d2ee06c0921c8a7a31ba374e69aa64f4c8b376
Sep 10 04:43:00.626780 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:00.626742    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq" event={"ID":"092340b8-d21c-4b82-83d6-34f8b3d5491b","Type":"ContainerStarted","Data":"339f24a39df724a879905d66bb3493e20ef1ce93175d3dd9c0cddca9b275da4b"}
Sep 10 04:43:00.626962 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:00.626797    2526 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq" event={"ID":"092340b8-d21c-4b82-83d6-34f8b3d5491b","Type":"ContainerStarted","Data":"89d3ecc7776cf41c2426fa49f0d2ee06c0921c8a7a31ba374e69aa64f4c8b376"}
Sep 10 04:43:00.626962 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:00.626875    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:43:00.645920 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:00.645855    2526 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq" podStartSLOduration=1.64583581 podStartE2EDuration="1.64583581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 04:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 04:43:00.645231971 +0000 UTC m=+1014.863258620" watchObservedRunningTime="2026-09-10 04:43:00.64583581 +0000 UTC m=+1014.863862489"
Sep 10 04:43:01.297939 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:01.297882    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:43:01.298310 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:43:01.298102    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:43:01.791702 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:01.791674    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74ctt_9d98d7d6-96a4-4237-b749-a89bd1adfa88/dns/0.log"
Sep 10 04:43:01.810837 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:01.810816    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74ctt_9d98d7d6-96a4-4237-b749-a89bd1adfa88/kube-rbac-proxy/0.log"
Sep 10 04:43:01.935367 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:01.935334    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pf2s7_9a52f818-b30f-44fb-982c-6a206dbb8dd7/dns-node-resolver/0.log"
Sep 10 04:43:02.298150 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:02.298119    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:43:02.298514 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:43:02.298338    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:43:02.497165 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:02.497136    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nj585_6fef90e3-41fe-47ea-be33-937fa28a2427/node-ca/0.log"
Sep 10 04:43:03.412590 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:03.412561    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8_b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e/istio-proxy/0.log"
Sep 10 04:43:03.470917 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:03.470889    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-dfqx6_245fec92-534d-47e1-9098-521cc3b7bca1/kube-auth-proxy/0.log"
Sep 10 04:43:03.514785 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:03.514758    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/1.log"
Sep 10 04:43:03.515258 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:03.515241    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/0.log"
Sep 10 04:43:03.534530 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:03.534502    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hqfp4_f23e9f4d-890d-4a30-a8b3-631d3e586293/payload-pre-processing/0.log"
Sep 10 04:43:04.216686 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:04.216657    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xr4vn_d84ec46c-caa3-40d4-adc9-3a4bbb4dd1e2/serve-healthcheck-canary/0.log"
Sep 10 04:43:04.682176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:04.682146    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7z28_4b935618-42c1-4e86-ad7a-433e5f671bf6/kube-rbac-proxy/0.log"
Sep 10 04:43:04.701861 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:04.701827    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7z28_4b935618-42c1-4e86-ad7a-433e5f671bf6/exporter/0.log"
Sep 10 04:43:04.720463 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:04.720441    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7z28_4b935618-42c1-4e86-ad7a-433e5f671bf6/extractor/0.log"
Sep 10 04:43:06.641432 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:06.641405    2526 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zfjbl/perf-node-gather-daemonset-wznjq"
Sep 10 04:43:06.885383 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:06.885356    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7v75n_12bf9b71-2407-4184-af9b-a2c45210d105/manager/0.log"
Sep 10 04:43:06.918368 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:06.918283    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2m8xh_6b5bad58-114a-46fc-92c1-2d58681669ac/manager/0.log"
Sep 10 04:43:06.948176 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:06.948150    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-79b4ff944b-6hskm_f87bdc6c-77b2-42b7-a1b1-77fe2a62fc24/manager/0.log"
Sep 10 04:43:06.970976 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:06.970951    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6d6qc_9b84c280-d9ef-4d15-9185-7bd50418b278/server/0.log"
Sep 10 04:43:07.021572 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:07.021543    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l9h5x_31889ee2-17ab-4050-b0ac-8c14566e0dd6/manager/0.log"
Sep 10 04:43:07.164989 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:07.164950    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-z9q8j_b2750d83-8243-4524-817f-0b6b9696ebf6/manager/0.log"
Sep 10 04:43:07.180478 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:07.180408    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c4448dfb9-z9q8j_b2750d83-8243-4524-817f-0b6b9696ebf6/copy-manifests/0.log"
Sep 10 04:43:10.313000 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:10.312972    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8_b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e/istio-proxy/0.log"
Sep 10 04:43:10.361862 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:10.361826    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-dfqx6_245fec92-534d-47e1-9098-521cc3b7bca1/kube-auth-proxy/0.log"
Sep 10 04:43:10.402544 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:10.402511    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/1.log"
Sep 10 04:43:10.402841 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:10.402823    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/0.log"
Sep 10 04:43:10.421400 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:10.421376    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hqfp4_f23e9f4d-890d-4a30-a8b3-631d3e586293/payload-pre-processing/0.log"
Sep 10 04:43:11.648315 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:11.648290    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8rfm8_b975cf5a-a6ba-4055-8c78-2e2b3cac8f5e/istio-proxy/0.log"
Sep 10 04:43:11.712100 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:11.712070    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-dbb8dffb6-dfqx6_245fec92-534d-47e1-9098-521cc3b7bca1/kube-auth-proxy/0.log"
Sep 10 04:43:11.762232 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:11.762207    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/1.log"
Sep 10 04:43:11.762666 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:11.762649    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vkzk9_b5224073-c872-4142-9df3-5b4ad6448635/istio-proxy/0.log"
Sep 10 04:43:11.775829 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:11.775808    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hqfp4_f23e9f4d-890d-4a30-a8b3-631d3e586293/payload-pre-processing/0.log"
Sep 10 04:43:14.297578 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:14.297548    2526 scope.go:117] "RemoveContainer" containerID="ebf4193955940b8efc13553d2e1178d6e5fdf4e08362e32fa6e5c85033e45b4c"
Sep 10 04:43:14.298081 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:43:14.297721    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r_llm(dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-j2f2r" podUID="dd2f1bce-3b05-4aa1-b711-49d9a46bdfc6"
Sep 10 04:43:14.996466 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:14.996431    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5cvdw_581446c7-957c-451d-b279-b7e53ac6dd6d/kube-multus/0.log"
Sep 10 04:43:15.045516 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.045486    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/kube-multus-additional-cni-plugins/0.log"
Sep 10 04:43:15.064598 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.064570    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/egress-router-binary-copy/0.log"
Sep 10 04:43:15.084556 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.084532    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/cni-plugins/0.log"
Sep 10 04:43:15.104251 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.104225    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/bond-cni-plugin/0.log"
Sep 10 04:43:15.121461 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.121441    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/routeoverride-cni/0.log"
Sep 10 04:43:15.138650 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.138630    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/whereabouts-cni-bincopy/0.log"
Sep 10 04:43:15.156509 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.156487    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4rm6n_c0827b42-4689-44cc-b80b-ba4d580107eb/whereabouts-cni/0.log"
Sep 10 04:43:15.524116 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.524084    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84mxk_49799fb0-faa9-433b-8f94-a9873983ffda/network-metrics-daemon/0.log"
Sep 10 04:43:15.541255 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:15.541234    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84mxk_49799fb0-faa9-433b-8f94-a9873983ffda/kube-rbac-proxy/0.log"
Sep 10 04:43:16.300469 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.300440    2526 scope.go:117] "RemoveContainer" containerID="c753727e6988f4836a843033f2c37be87197598fc0adf2ea226aee35f36844a9"
Sep 10 04:43:16.300708 ip-10-0-137-116 kubenswrapper[2526]: E0910 04:43:16.300674    2526 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn_llm(7636e8b8-4363-4e89-b98d-cb8b15277a97)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-vvlrn" podUID="7636e8b8-4363-4e89-b98d-cb8b15277a97"
Sep 10 04:43:16.709481 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.709441    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/ovn-controller/0.log"
Sep 10 04:43:16.724569 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.724544    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/ovn-acl-logging/0.log"
Sep 10 04:43:16.745732 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.745712    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/kube-rbac-proxy-node/0.log"
Sep 10 04:43:16.764537 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.764511    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 04:43:16.782110 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.782086    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/northd/0.log"
Sep 10 04:43:16.801147 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.801124    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/nbdb/0.log"
Sep 10 04:43:16.820684 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.820664    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/sbdb/0.log"
Sep 10 04:43:16.856995 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:16.856972    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pt4pq_52bbea76-3846-46f4-9d9b-1fc303da8083/ovnkube-controller/0.log"
Sep 10 04:43:17.974786 ip-10-0-137-116 kubenswrapper[2526]: I0910 04:43:17.974759    2526 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9cd9j_f3935ba8-636e-474c-b7cc-22854fed158a/network-check-target-container/0.log"